Home  Mind Map  Details

Data analysis knowledge

2024-10-22 16:19:20   0  Report





Other creations by the author

Outline/Content

Fundamentals of Data Analysis

Statistical reserves

Discrete distribution and continuous distribution

Hypothesis testing

Parameter inspection

Nonparametric test

Normality test

Distribution fitting test

Construct your own hypothesis test: the significance of operational activities

Parameter Estimation Method

Maximum likelihood method

Method of Moments Estimation

Linear Algebra

Eigenvalues and eigenvectors

The meaning of matrix operations

Analyzing language and tools

Data preprocessing

Write functions: cross-validation implementation function & Newton's iteration algorithm, etc.

Visualization: ggplot2 regular graph & machine learning visualization results presentation, etc.

Machine Learning Parameter Tuning

Python

Data preprocessing

Python Data Analysis

Implementation of machine learning algorithms

Visualization

Python Algorithm Structure

Web crawlers and natural language processing

Structured Query Language

group by & union

The order of syntax and execution

Hive Optimization: Sort Optimization and Join Optimization, etc.

Principles and Practical Experience of Hadoop

Write execution scripts (Perl and shell)

SPSS, Stata, and Eviews, etc. commercial analytical software

Algorithm Principle

category

Classification algorithm

Regression algorithm

Association analysis

Clustering

Ensemble learning

The principles of boostrap and bagging

Similarities and Applicable Scope

Application: Principles of Random Forest, XGBoost, etc.

Model Selection and Evaluation

Model Applicable Scenarios

Model parameter tuning and evaluation

Knowledge of data analysis techniques

Data collection

Define the analysis dimensions

Extract indicators from various dimensions

Data preprocessing

Format conversion

Variable generation

Missing value handling

Variable discretization

I will follow your instructions and translate the given sentence into English. First, I will understand the overall meaning of the sentence. Then, I will ensure that the translation is accurate, the grammar structure is smooth, and the language expression is elegant. Finally, I will output the translated sentence in English. Here is the translation: ······

Modeling Analysis

Test set/training set division

Model Selection

Parameter Selection

Model Evaluation

Accuracy

ROC and AUC

Confusion matrix

Objective function

······

Model Optimization and Monitoring

The subsequent fitting situation of the model