📊 Data Science

Data Anomaly Simulator: Normalized vs Denormalized SchemasNewRun insert, update and delete operations against a denormalized table and its normalized 3NF… Simpson's Paradox: When Grouped Trends ReverseNewWatch a negative trend inside every subgroup of a dataset flip into a positive trend once… Outlier Detection Lab: Tukey's IQR FencesNewGenerate a dataset and watch it rendered as a live 3D box plot — drag the IQR fence… Colormap Perception LabNewInteractive 3D terrain colored by real colormaps (Viridis, Jet, grayscale): measure how… Squarified Treemap Layout SimulatorNewRun the real squarified-treemap algorithm (Bruls, Huizing & van Wijk) on live weighted… Columnar Compression: Dictionary & Run-Length EncodingNewInteractive 3D columnar-storage simulator: watch dictionary encoding and run-length encoding… Mean-Shift Clustering: Climbing the Density LandscapeNewWatch data points climb a live 3D kernel-density surface toward its local peaks in this… Lambda Architecture: Batch & Speed Layer ReconciliationNewAn interactive 3D simulator of the Lambda/Kappa big-data architecture: watch events flow… ACF/PACF Order Identification: Reading a Time Series' Autocorrelation SignatureNewGenerate AR, MA, or random-walk time series and watch their autocorrelation (ACF) and… Partial Dependence & ICE Plot ExplorerNewExplore how a partial dependence plot averages a model's response surface across sampled… Domain-Adversarial Transfer Learning: The Gradient Reversal LayerNewInteractive 3D visualizer of a Domain-Adversarial Neural Network (DANN): a domain classifier… Deep Feature Synthesis: Automated Feature EngineeringNewWatch automated feature engineering walk a relational Customers → Transactions → Categories… Columnar vs Row Storage: Analytical Scan CostNewRun the same analytical query against a row-oriented and a column-oriented table layout in… Machine Unlearning: The Right to Be ForgottenNewInteractive SISA machine-unlearning simulator: file a GDPR erasure request on a training… Nesterov Momentum: Look-Ahead Gradient on an Ill-Conditioned ValleyNewRace plain gradient descent, classical momentum, and Nesterov accelerated gradient down an… Recommender Popularity Bias: The Rich-Get-Richer Feedback LoopNewWatch collaborative-filtering exposure feedback concentrate recommendations onto a shrinking… Curse of Dimensionality: Distance ConcentrationNewWatch a random point cloud's pairwise distances concentrate and its inscribed hypersphere's… Probability Calibration — Reliability Diagrams & Brier ScoreNewGenerate a synthetic classifier's predicted probabilities, dial in over- or… Columnar Storage & Predicate PushdownNewInteractive 3D simulator comparing row-major vs columnar table layout: toggle dictionary… Anscombe's Quartet: Why You Must Plot Your DataNewAn interactive 3D gallery of Anscombe's Quartet: four datasets sharing an almost identical… Difference-in-Differences: Policy Effect EstimatorNewWatch treated and control group outcomes evolve across ten time periods around a policy… GradNorm: Loss Weighting for Multi-Task LearningNewWatch three task heads train through one shared trunk while Equal, Uncertainty, or GradNorm… PackNet: Capacity Packing for Continual LearningNewWatch iterative magnitude pruning carve a fixed-size neural network into frozen,… Base-Rate Fairness Impossibility LabNewSee the fairness impossibility theorem in action: two demographic groups scored by the same… Missing Data Mechanisms & Imputation Bias LabNewHide values from a synthetic dataset under MCAR, MAR or MNAR missingness, then repair it… Stationarity & Differencing: The ADF Test ExplorerNewBuild a non-stationary time series from trend, random-walk and seasonal components, then… Link Prediction Lab: Node Embeddings & Edge ScoringNewWatch a GCN-style neighbor-mean aggregation pull node embeddings together on a live 3D… Vector Space Search Engine: TF-IDF Document RetrievalNewType a search query and watch it get tokenized, weighted with TF-IDF, and ranked against a… BM25 Ranking: How Search Engines Score DocumentsNewInteractive 3D BM25 ranking simulator: tune the term-frequency saturation constant k1 and… RDF Knowledge Graph & SPARQL Pattern ExplorerNewInteractive 3D RDF knowledge graph: watch a force-directed subject-predicate-object triple… Instrumental Variables: Untangling a Confounded CauseNewA live 3D point cloud of a confounded cohort shows how a hidden variable biases the naive… Gradient Surgery: Resolving Conflicting Task Gradients (PCGrad)NewWatch a shared parameter vector descend two or three quadratic task-loss bowls on a live 3D… Symbolic Regression: Evolving Physical Laws from DataNewGenetic programming evolves a population of expression trees against noisy free-fall,… Factorization Machines: Wide + Deep Feature InteractionsNewTrain a real Factorization Machine live in 3D: pick a user/item/device/time example, label… Grubbs' Test: Iterative Outlier RejectionNewInteractive 3D simulator of Grubbs' test for outliers: compute the G statistic against a… Silhouette Score: Finding the Right Number of ClustersNewInteractive 3D silhouette-score analyzer: run K-means clustering live, watch a colored bar… UMAP Layout Optimizer: Attractive & Repulsive ForcesNewWatch UMAP's force-directed embedding optimizer run live in 3D: k-nearest-neighbor graph… AdaBoost: Sample Reweighting in ActionNewInteractive 3D AdaBoost simulator: watch sample weights grow after every misclassification,… Regression Metrics Explorer — MAE, RMSE, R² & MAPENewWatch MAE, RMSE, R² and MAPE update live on a 3D predicted-vs-actual bar chart as you add… Feature Scaling Lab: Why Gradient Descent Needs Normalized FeaturesNewWatch the same dataset train four ways at once — raw, StandardScaler, MinMaxScaler and… Missing Data Imputation Lab: Mean, KNN & Regression FillNewHide values in a correlated synthetic dataset under MCAR or biased MAR missingness, then… Permutation Feature Importance LabNewFit a real linear-regression model to a synthetic dataset, then shuffle one feature column… Stationarity & the Unit Root: Random Walk vs AR(1) DifferencingNewGenerate an AR(1) time series live, push its coefficient to a unit root to see a… Correlation Heatmap & Pair-Plot ExplorerNewGenerate a five-variable synthetic dataset with a controllable target correlation, watch the… Government Record Linkage — Probabilistic Entity ResolutionNewMatch synthetic citizen records across two siloed government databases using the real… DAU/MAU Stickiness SimulatorNewStep a population of 900 mobile-app users day by day, each with a fixed activation… Zipf's Law: Word Frequency vs RankNewGenerate a synthetic Zipfian word corpus, watch its log-log rank/frequency plot fit a… Reactor Sensor Correlation & Anomaly StreamNewTwo live reactor sensor streams — temperature under thermostat feedback control and coupled… Cross-Validation Lambda Tuner: Ridge RegressionNewAn interactive 3D k-fold cross-validation simulator: watch ridge regression's regularization… ACF/PACF Correlogram: Identifying ARIMA OrderNewGenerate a stationary ARMA(1,1) process, integrate it d times into a non-stationary series,… Predictive Analytics: Time-Series Forecast SimulatorNewInteractive time-series forecasting simulator: watch a trend + seasonality model project… Text Vectorization Lab: BoW vs TF-IDF Live DemoNewExplore text vectorization using BoW and TF-IDF on synthetic tweets. See how different… Sampling Bias SimulatorNewInteractive 3D survey town of 400 households across four neighborhoods with different real… Civic Data PlaygroundNewInteractive 3D city grid built from open municipal data: tune population, traffic-light… Data Analysis Fundamentals SimulatorNewInteractive 3D scatterplot lab: generate a noisy dataset, inject outliers, and watch a live… Data Visualization ExplorerNewInteractive 3D bar chart and scatter plot built from the same generated dataset: tune sample… Dimension CollapseNewAn N-dimensional hypercube spins through its extra-dimensional rotation planes while a… Experimental Design FundamentalsNewInteractive control-vs-treatment trial simulator: tune sample size, true effect size, noise… Stream Window Aggregator: Tumbling vs SlidingNewWatch a live event stream flow past tumbling and sliding aggregation windows, with Poisson… Topic Modeling: Documents as Mixtures of TopicsNewInteractive LDA-style topic model: sample a document's topic mixture from a Dirichlet… Categorical Encoding LabNewSwitch a categorical feature between one-hot, label, frequency and target encoding and watch… One-Class SVM Anomaly BoundaryNewWatch a one-class SVM (RBF-kernel density) boundary enclose a normal data cloud in 3D — tune… Spot vs On-Demand Cloud TrainingNewInteractive 3D cloud ML training cluster: mix spot and on-demand instances, tune… Truncated Axis IllusionNewDrag a Y-axis truncation slider on a two-bar chart and watch the exact same underlying… Classifier Complexity: Underfitting vs OverfittingNewDrag a classifier-complexity slider across a curved two-class dataset with noisy mislabeled… Cold-Start: Collaborative vs Content-Based FallbackNewTwo brand-new users join a recommender: pure collaborative filtering has zero rating history… Bag-of-Words vs TF-IDFNewA 3D term-weight bar chart that compares Bag-of-Words counts against TF-IDF weights across… Cookie Policy — MySimulator.ukNewCookie Policy for MySimulator.uk — what cookies and local storage we use, and how to control… The Hadoop Ecosystem: HDFS, MapReduce & YARNNewA 3D data-centre model of a Hadoop cluster: watch HDFS split and replicate a file into… Metadata Standards and Open Data Practices for Apiary ResearchNewA 3D data pipeline where raw hive sensor readings pass through metadata validation gates —… Fusing ACLED, ADS-B, AIS and GDELTNewA 3D globe where conflict-event reports, aircraft tracks, ship tracks and news pulses from… Stats — 3D Browser SimulationsNewLive statistics for 3D Browser Simulations — simulation count, categories, articles, your… Bag-of-Words vs TF-IDF: Tweet Sentiment ClassifierNewWatch a live nearest-centroid classifier sort tweets into positive/negative/neutral in a 3D… Live Analytics DashboardNewReal-time 3D analytics dashboard: hourly traffic bars, a device-coloured visitor particle… Apiary Analytics & KPI DashboardsNewA live apiary KPI dashboard: simulated inspection rounds drift colony strength, mite load… Research Collaboration NetworkNewResearchers form a co-authorship network — watch how connectivity and publication rate… Data Pipeline Automation ConsoleNewRaw data flows through automated ingestion, cleaning and loading stage nodes — watch… Audio Spectrogram Processing GridNewA grid of frequency-bin nodes pulses with live amplitude as a synthetic audio signal streams… Recommendation System Bipartite GraphNewUsers and items form a bipartite graph — watch recommendation edges strengthen as similarity… Anomaly Detection Point CloudNewNormal data points cluster tightly while injected anomalies drift outward — tune detection… Model Evaluation ROC SpaceNewPredictions land as TP/FP/TN/FN nodes around a moving decision threshold — slide it and… Feature Engineering Transform GraphNewRaw feature nodes flow through transform nodes (scaling, encoding, interaction terms) into… Data Engineering: Building Modern Data InfrastructureNewA practical guide to data engineering: data pipelines, warehousing, lakehouse architecture,… Data Science: A Physics PerspectiveNewExplore the core concepts of data science – analytics, modeling, and machine learning –… Advanced Cybersecurity Simulation: Threat ResponseNewThis simulation challenges users to respond effectively to simulated cybersecurity threats,… Advanced Data Ethics Simulation: Responsible Data HandlingNewNavigate intricate ethical challenges surrounding data collection, storage, and usage within… Data Ethics Scenario NavigationNewThis simulation presents users with scenarios requiring them to navigate the ethical… Automation Data Automation SimulationNewThis simulation demonstrates how data is used to drive automation processes. It showcases… Big Data SimulationNewThis simulation demonstrates the visualization and analysis of large datasets. It explores… Entrepreneurship Market Validation SimulationNewPlayers conduct market research and testing to validate their product or service idea before… Ά× Structured Data Audit | Science PortalNewThis simulation guides users through the process of auditing and structuring scientific data… Kafka Event Stream VisualizerNewInteractive 3D pipeline of topics, partitions and consumer groups where publishing events… BI Semantic Layer ModelerNewInteractive 3D data-warehouse-to-dashboard pipeline where redefining a metric in the… Data Lake to Lakehouse ExplorerNewInteractive 3D storage architecture where adding a transactional table layer over raw object… Data Lineage Trace ExplorerNewInteractive 3D graph of tables, transforms and dashboards where clicking a metric traces its… Data Mesh Domain ExplorerNewInteractive 3D network of domain-owned data products where reassigning ownership shows how a… ETL vs ELT Pipeline ComparatorNewInteractive 3D side-by-side pipeline where routing raw data through transform-then-load… Feature Store Skew DetectorNewInteractive 3D pipeline splitting into training and serving paths where injecting a… MongoDB Document Model ExplorerNewInteractive 3D document-collection scene where toggling schema flexibility and sharding… PostGIS Spatial Index ExplorerNewInteractive 3D map-and-index scene where running spatial queries shows how PostGIS's R-tree… Hive Sensor Monitoring DashboardNewInteractive 3D hive rigged with weight, temperature and humidity sensors where adjusting… Mutual Information ExplorerNewInteractive 3D joint-distribution scene where reshaping two variables' dependency shows how… Dimensionality Reduction: PCA, t-SNE & UMAPNewWatch real PCA (covariance eigendecomposition), a live t-SNE-style optimisation, and a… Regression Visualizer: Linear, Polynomial & RegularizationNewFit noisy data live with real least-squares regression — slide the polynomial degree to see… Time Series Decomposition: Trend, Seasonality & ResidualsNewDecompose a synthetic time series into trend, seasonality and residuals in real time —… Monte Carlo Estimation: From π to Financial RiskNewWatch genuine Monte Carlo simulation run live in 3D: estimate π, estimate a definite… Confusion Matrix & ROC-AUC ExplorerNewDrag the decision threshold across two overlapping score distributions and watch the…