towardsdatascience.com

Similarity Search with IVFPQ

Find out how the inverted file index (IVF) is implemented alongside product quantization (PQ) for a fast and efficient approximate nearest...

Create a Bot to Find Diamonds in Minecraft

Reinforcement Learning and Behavior Cloning in Python with MineRLImage by author (Mojang license)Minecraft is the next frontier for...

Getting Started With Streamlit Web Based Applications

A gentle introduction to creating Streamlit web appsPhoto by Caspar Camille...

Start-Up Data Mesh Blueprint: 3 Steps for Becoming a Data-Driven Start-Up through the Data Mesh

A dead-simple 3-step blueprint for start-ups to get data-driven right through the data meshThe 3-step blueprint for becoming a data meshed data-driven start-up. Image by Author.The word “data mesh” is the top...

MLOps: How to Operationalise E-Commerce Product Recommendation System

Photo by JJ Ying on UnsplashIntroductionOne of the most common challenges in an e-commerce business to build a well-performing product recommender and categorisation model. A product recommender is used to recommend...

Recursion for Data Scientists

Recursively search JSON API responses to accelerate your productivityCredit: Pexels.comFor data scientists, the temptation is real to bypass computer science fundamentals and software engineering best practices in...

Top 12 advice on BigQuery and SQL for beginners

Start your data warehouse project with BigQuery the right wayPhoto by Cathryn Lavery on UnsplashIntroductionBigQuery is one of many data warehouse solutions but stands out as one of the most popular. After a rapid...

A Complete Guide to Decision Trees

Learn everything you need to know about decision trees, including a Python examplePhoto by Simon Wilkes on UnsplashThe Decision Tree is a machine learning algorithm that takes its name from its tree-like structure and...

First, We Must Discover. Then, We Can Explore.

A case for a structured data-discovery approachPhoto by Clarisse Meyer on UnsplashBack in the slammin’ 70s, John Tukey published Exploratory Data Analysis, through which he championed the idea of playing around with...

Stat Stories: Variable Transformation to Generate New Distributions

Transformation of statistical distributionsCover picture by the author.Often we are required to generate a new distribution or density function with closed forms from a given distribution. Programmatically, it might be...

Engineering Best Practices to Apply to Your Analytics Workflow

How to use Github, versioning, and data quality testing to your advantagePhoto by Estúdio Bloom on UnsplashWhether you started your career as a data engineer, data scientist, or data analyst, best practices in each...

SourceCodeAI — how to handle Train-Inference mismatch

SourceCodeAI — how to handle Train-Inference mismatchPhoto by Alex Dumitru from PexelsSource code AI has many unique features which differentiate it from the more general NLP applications (like the common...

High scalable fast search with Haystack

Put your FAQ search on steroids with Elasticsearch and GPUPlay it safe with embedded word search with Haystack (Photo by Rutpratheep Nilpechr)In a previous post we created a simple “string match search” to find...

Automating the process of Video Creation using Machine Learning

Using machine learning to summarize news articles and creating a short video feedPhoto by Mark Cruz on UnsplashWith the rise in consumption of short format videos and highly personalized content, have you ever thought...

5 Ways to Use Histograms with Machine Learning Algorithms

From a feature engineering perspectivefeature engineering with histogram for machine learning (image by author)Feature engineering is the process of using domain knowledge to create features that make machine learning...

3 Strategies To Redefine Your Executive Career Path With AI

Photo by Mike Lewinski on UnsplashThree ways leaders can put their AI education to useArtificial Intelligence (AI) is disrupting businesses and job roles in every industry, causing concerns about long-term job...

Apply Data Quality Checks at These 5 Points in Your Data Journey

Improve Quality of Your Data by Applying These Checks in Your JourneyPhoto by Martin Adams on UnsplashImagine you have just delivered a fancy new Data Lake with some cool Data Pipelines that bring data from all over...

Weak Supervision with Snorkel for Multilabel Classification Tasks

Hands-on TutorialsLabel your data programmaticallyPhoto by Swanson Chan on UnsplashTable of Contents:· Exploratory Data Analysis· Keyword Labeling Functions· Heuristic Labeling Functions· Labeling Functions with...

How I tested the Hungarian Election for fraud using Benford’s law

I tested several datasets using Benford’s law and learned about the advantages and pitfalls.Distribution of first digits according to Benford’s law. All images unless otherwise noted are by the authorI recently...

Ethics And Conversational Assistants

OpinionIn recent years, trust and consideration of ethical rules have become an essential part of the AI landscape. Early abuses have led legislators to regulate the industry after the fact. This article discusses the...

What Are Transposed Convolutions?

Understanding how the "reverse" convolution worksPhoto by Philippe D. on UnsplashIntroductionTransposed convolutions are like the "ugly duckling" of the convolutional family. They are quirky and...

How To Run A/B Tests

A simple guide on how to use statistics to run A/B tests on proportionsImage by authorOnline marketing and startup growth are better if you can continuously test different ideas. The statistic comes into help when we...

BERTScore: Evaluating Text Generation with BERT

Machine Learning Research Paper SummaryImage by AuthorBERTScore is an automatic evaluation metric used for testing the goodness of text generation systems. Unlike existing popular methods that compute token level...

Key Learning Points from MLOps Specialization — Course 4

MLOPS SPECIALIZATION SERIESKey Learning Points from MLOps Specialization — Course 4Final insights (with lecture notes) from the Machine Learning Engineering for Production (MLOps) Course by DeepLearning.AI &...

Dickey-Fuller Optimization: Tackle Time Series Cointegration Head-on

Never mind the maneuvers; minimize the Dickey-Fuller statistic directly to achieve a stationary time series. Full Python code.Image by author.There are many methods for finding cointegrating vectors. Some methods...