Data Science Assessment Test

Amazon's electronics store division has over the last few months focused on getting customer feedback on their products, and marking them as safe/ unsafe. Their data science team has used decision trees for this. 

The training set has these features: product ID, data, summary of feedback, detailed feedback and a binary safe/unsafe tag. During training, the data science team dropped any feedback records with missing features. The test set has a few records with missing "detailed feedback" field. What would you recommend?

A: Remove the test samples with missing detailed feedback text fields
B: Generate synthetic data to fill in missing fields
C: Use an algorithm that handles missing data better than decision trees
D: Fill in the missing detailed feedback text field with the summary of feedback field.

Your friend T-Rex is working on a logistic regression model for a bank, for a fraud detection usecase. The accuracy of the model is 98%. T-Rex's manager's concern is that 85% of fraud cases are not being recognized by the model. Which of the following will surely help the model recognize more than 15% of fraud cases?

Your data science intern Rox was asked to create a decision tree classifier with 12 input variables. The tree used 7 of the 12 variables, and was 5 levels deep. Few nodes of the tree contain 3 data points. The area under the curve (AUC) is 0.86. As Rox's mentor, what is your interpretation?

A. The AUC is high, and the small nodes are all very pure- the model looks accurate.
B. The tree might be overfitting- try fitting shallower trees and using an ensemble method.
C. The AUC is high, so overall the model is accurate. It might not be well-calibrated, because the small nodes will give poor estimates of probability.
D. The tree did not split on all the input variables. We need a larger data set to get a more accurate model.

You are working on a regression problem using a simple neural network. You want to optimize the model's weights using gradient descent with different learning rate schedules. Consider the following pseudo code for training the neural network:

Which of the following learning rate schedules would most likely result in the fastest convergence without overshooting the optimal weights?

A: Constant learning rate of 0.01
B: Exponential decay with initial learning rate of 0.1 and decay rate of 0.99
C: Exponential decay with initial learning rate of 0.01 and decay rate of 0.99
D: Step decay with initial learning rate of 0.1 and decay rate of 0.5 every 100 epochs
E: Step decay with initial learning rate of 0.01 and decay rate of 0.5 every 100 epochs
F: Constant learning rate of 0.1

You are given a dataset to solve a classification problem using a decision tree algorithm. You are concerned about overfitting and decide to implement pruning to control the model's complexity. Consider the following pseudo code for creating the decision tree model:

Which of the following combinations of parameters would result in a less complex decision tree model, reducing the risk of overfitting?

A: max_depth=5, min_samples_split=2, min_samples_leaf=1
B: max_depth=None, min_samples_split=5, min_samples_leaf=5
C: max_depth=3, min_samples_split=2, min_samples_leaf=1
D: max_depth=None, min_samples_split=2, min_samples_leaf=1
E: max_depth=3, min_samples_split=10, min_samples_leaf=10
F; max_depth=5, min_samples_split=5, min_samples_leaf=5

Our newest machine learning developer want to write a function to calculate the n-gram of any text. An N-gram means a sequence of N words. So for example, "black cats" is a 2-gram, "saw black cats" is a 3-gram etc. The 2-gram of the sentence "the big bad wolf fell down" would be [["the", "big"], ["big", "bad"], ["bad", "wolf"], ["wolf", "fell"], ["fell", "down"]]. Can you help them select the correct function for the same?

You are tasked with building a recommendation system for a newly launched e-commerce website. Given that the website is new, there is not much user interaction data available. Also, the items in the catalog have rich descriptions. Based on these requirements, which type of recommendation system approach would be the most suitable for this task?

You have trained a supervised learning model to classify customer reviews as either "positive" or "negative" based on a dataset with 10,000 samples and 35 features, including the review text, reviewer's name, and rating. The dataset is split into a 7,000-sample training set and a 3,000-sample test set.

After training the model, you evaluate its performance using a confusion matrix on the test set, which shows the following results:

Based on the confusion matrix, what are the sensitivity and specificity of the model?

A bag contains 5 red balls, 6 yellow balls and 3 green balls. If two balls are picked at random, what is the probability that both are red or both are green in colour?

What is the probability that two uniformly random points in the square are such that center of the square lies in the circle formed by taking the points as diameter

Convert the following into an ordinary frequency distribution:

- 5 users gave less than 3 rating
- 12 users gave less than 6 rating
- 25 users gave less than 9 ratings
- 33 users get less than 12 ratings