Applied AI Scientist Test

You are asked to create a prompt for a language model that outputs JSON data for a company's employee database. The JSON must include an employee's ID, name, age, and whether they are currently active. Consider how you might structure your prompt given these fields. Identify the best prompt design.

Example JSON output:
{
   "ID": "123",
   "Name": "John Doe",
   "Age": 30,
   "Active": true
}

Which prompt structure would most effectively guide the language model to generate the correct JSON format?
A: Create JSON objects for employees with fields: ID, Name, Age, Active. ID should be a string.
B: Generate JSON data: ID, Name, Age, Active. ID is a number.
C: Output JSON: ID (string), Name, Age (integer), Active (boolean).
D: Make JSON: ID, Name, Age, Active. ID is always number.
E: Design JSON response: ID, Name, Age, Active with clear typing.
F: Provide JSON example: Employee data with structured fields.

Consider the following prompt given to an LLM:

System Prompt: "You are a creative writing assistant helping authors develop character descriptions. Use vivid imagery and engaging language to bring characters to life."
Main Prompt: "Write a character description for a mysterious librarian with the following traits:

Works in an ancient library
Has silver hair and green eyes
Knows secrets about forbidden books
Appears to be in their 40s but seems much older
Always wears a pendant with strange symbols"

Three outputs were generated with different temperature settings:

Output A:
"The librarian possesses silver hair and green eyes. Age appears to be approximately 40 years. Works in an ancient library facility. Has knowledge of restricted book collections. Wears jewelry featuring symbolic markings. Maintains professional demeanor while handling library materials."
Output B:
"Elara moves through the ancient library like a ghost haunting familiar halls, her silver hair catching moonbeams that slip through Gothic windows. Those emerald eyes hold centuries of secrets—too many secrets for someone who claims only four decades of life. The obsidian pendant at her throat pulses with runes that predate any known language, and when she speaks of the forbidden texts, her voice carries the weight of ages. There's something unsettling about how she never seems surprised by anything, as if she's been waiting lifetimes for each visitor to find their way to her domain."
Output C:
"Meet Elara, the enigmatic keeper of knowledge whose silver locks frame a face that defies time itself. Her piercing green eyes seem to peer directly into your soul, holding secrets that could unravel reality. The ancient library around her creaks with whispered stories, and she alone holds the keys to the forbidden sections where dangerous truths slumber. The mystical pendant adorning her neck bears symbols older than civilization, pulsing with otherworldly energy that hints at her true nature."

Which temperature setting was most likely used for each output?
A) Output A (T=0.1), Output B (T=1.0), Output C (T=0.5)
B) Output A (T=0.5), Output B (T=0.1), Output C (T=1.0)
C) Output A (T=0.1), Output B (T=0.5), Output C (T=1.0)
D) Output A (T=1.0), Output B (T=0.5), Output C (T=0.1)
E) Output A (T=0.5), Output B (T=1.0), Output C (T=0.1)

You are working on a regression problem using a simple neural network. You want to optimize the model's weights using gradient descent with different learning rate schedules. Consider the following pseudo code for training the neural network:

Which of the following learning rate schedules would most likely result in the fastest convergence without overshooting the optimal weights?

A: Constant learning rate of 0.01
B: Exponential decay with initial learning rate of 0.1 and decay rate of 0.99
C: Exponential decay with initial learning rate of 0.01 and decay rate of 0.99
D: Step decay with initial learning rate of 0.1 and decay rate of 0.5 every 100 epochs
E: Step decay with initial learning rate of 0.01 and decay rate of 0.5 every 100 epochs
F: Constant learning rate of 0.1

You are given a dataset to solve a classification problem using a decision tree algorithm. You are concerned about overfitting and decide to implement pruning to control the model's complexity. Consider the following pseudo code for creating the decision tree model:

Which of the following combinations of parameters would result in a less complex decision tree model, reducing the risk of overfitting?

A: max_depth=5, min_samples_split=2, min_samples_leaf=1
B: max_depth=None, min_samples_split=5, min_samples_leaf=5
C: max_depth=3, min_samples_split=2, min_samples_leaf=1
D: max_depth=None, min_samples_split=2, min_samples_leaf=1
E: max_depth=3, min_samples_split=10, min_samples_leaf=10
F; max_depth=5, min_samples_split=5, min_samples_leaf=5

Our newest machine learning developer want to write a function to calculate the n-gram of any text. An N-gram means a sequence of N words. So for example, "black cats" is a 2-gram, "saw black cats" is a 3-gram etc. The 2-gram of the sentence "the big bad wolf fell down" would be [["the", "big"], ["big", "bad"], ["bad", "wolf"], ["wolf", "fell"], ["fell", "down"]]. Can you help them select the correct function for the same?

You are tasked with building a recommendation system for a newly launched e-commerce website. Given that the website is new, there is not much user interaction data available. Also, the items in the catalog have rich descriptions. Based on these requirements, which type of recommendation system approach would be the most suitable for this task?

You have trained a supervised learning model to classify customer reviews as either "positive" or "negative" based on a dataset with 10,000 samples and 35 features, including the review text, reviewer's name, and rating. The dataset is split into a 7,000-sample training set and a 3,000-sample test set.

After training the model, you evaluate its performance using a confusion matrix on the test set, which shows the following results:

Based on the confusion matrix, what are the sensitivity and specificity of the model?

We have trained a model on a linearly separable training set to classify the data points into 2 sets (binary classification). Our intern recently labelled some new data points which are all correctly classified by the model. All of the new data points lie far away from the decision boundary. We added these new data points and re-trained our model- our decision boundary changed. Which of these models do you think we could be working with?
The 2 data sources use SQL Server and have a 3-character CompanyCode column. Both data sources contain an ORDER BY clause to sort the data by CompanyCode in ascending order. 

Teylor wants to make sure that the Merge Join transformation works without additional transformations. What would you recommend?

A: Perceptron
B: SVM
C: Logistic regression
D: Guassion discriminant analysis

You are fine-tuning a Convolutional Neural Network (CNN) for image classification. The network architecture is as follows:

The model is trained using the following parameters:

- Batch size: 64
- Learning rate: 0.001
- Optimizer: Adam
- Loss function: Categorical cross-entropy

After several training epochs, you observe that the training accuracy is high, but the validation accuracy plateaus and is significantly lower. This suggests possible overfitting. Which of the following adjustments would most effectively mitigate this issue without overly compromising the model's performance?

A: Increase the batch size to 128
B: Add dropout layers with a dropout rate of 0.5 after each MaxPooling2D layer
C: Replace Adam optimizer with SGD (Stochastic Gradient Descent)
D: Decrease the number of filters in each Conv2D layer by half
E: Increase the learning rate to 0.01
F: Reduce the size of the Dense layer to 64 units

You are fine-tuning a Convolutional Neural Network (CNN) for an image classification task where the dataset is highly imbalanced. The majority class comprises 70% of the data. The initial model setup and subsequent experiments yield the following observations:

**Initial Setup:**

- CNN architecture: 6 convolutional layers with increasing filter sizes, followed by 2 fully connected layers.
- Activation function: ReLU
- No class-weighting or data augmentation.
- Results: High overall accuracy, but poor precision and recall for minority classes.

**Experiment 1:**

- Changes: Implement class-weighting to penalize mistakes on minority classes more heavily.
- Results: Improved precision and recall for minority classes, but overall accuracy slightly decreased.

**Experiment 2:**

- Changes: Add dropout layers with a rate of 0.5 after each convolutional layer.
- Results: Overall accuracy decreased, and no significant change in precision and recall for minority classes.

Given these outcomes, what is the most effective strategy to further improve the model's performance specifically for the minority classes without compromising the overall accuracy?

A: Increase the dropout rate to 0.7
B: Further fine-tune class-weighting parameters
C: Increase the number of filters in the convolutional layers
D: Add batch normalization layers after each convolutional layer
E: Use a different activation function like LeakyReLU
F: Implement more aggressive data augmentation on the minority class