data

A tribute to useful, but less interesting research findingsA few years ago as a Data Scientist I was presenting to co-workers an analysis I’d been working on. The presentation went fine and the work was...

40% a vacuum, 40% a janitor, and 20% a fortune-teller.Photo by Icons8 Team on UnsplashAccording to the Harvard Business Review, a data scientist has the sexiest job of the 21st century. In the world of big data, they...

Ori Rafael Ori Rafael is CEO of Upsolver, which delivers a self-service data lake ETL platform that bridges the gap between data lakes and data consumers and enables organizations to unlock the value of their cloud...

In a modern data platform, distributed streaming systems are used to read data coming off of an application in real-time. There are a wide variety of streaming systems, including Kafka Streams, Apache Samza, Apache...

Analysing data from a Whatsapp chat with my girlfriendValentine’s Day 2020 has recently passed. The day of the year where couples celebrate their relationship and social media is awash with posts, pictures and praises...

Facebook’s proposal to the EU to tone down what the company called “intrusive regulations,” was rejected. European commissioner for the internal market Thierry Breton said that it was up to Facebook to adopt...

An essential concept to create accurate machine learning modelsImage by Arek Socha from PixabayTable of ContentIntroductionWhat is statistical bias?Types of statistical biasIntroductionImagine this.You’re running...

InfluxData sponsored this podcast. Time series data management continues to be used to back application deployments today across on-premises, and increasingly, cloud native environments. Whether it’s video streaming,...

It’s called crawling for a reason.Anyone kind enough to expose information over a network API is also likely to enforce rate limits on API clients. This mitigates the risk of denial of service attacks, helps the API...

A guide to help you start your career in Data Science!ForewordHi!The following pages are intended to help serve those looking to break into the Data Science field. It is a compilation of all the notes that I have taken...

Google đã xóa 500 Tiện ích mở rộng độc hại Chrome khỏi Web Store của mình sau khi họ phát hiện những tiện ích này chèn quảng cáo độc hại và đánh cắp dữ liệu duyệt web...

In a MySQL master-slave high availability (HA) setup, it is important to continuously monitor the health of the master and slave servers so you can detect potential issues and take corrective actions. In this blog post,...

In Chapter 5 of Numbers Rule Your World (link), I told the story of how Professor Rosenthal used statistical evidence to uncover a cheating scandal in a Canadian lottery. Statistics can be very powerful in identifying...

A data pipeline is a series of steps that takes large data sets and creates usable results from them. At the beginning of a data pipeline, a data set might be pulled from a database, a distributed file system, or a...

Photo Credit: https://www.flickr.com/photos/takomabibelot/A solution that simplifies the process of changing the order of DataFrame columnsIntroductionDozens of blog posts, stackoverflow.com threads, quora.com articles,...

One of the basic blunders of the rash data scientist.Photo by Markus Spiske on UnsplashMulticollinearity is a property of datasets that can leave you with unexpected, erratic, but not technically wrong interpretations...

What it is, and some of the techniques at your disposalThe task of analyzing data has been around for a long time, but practicing it was a tremendously slow process until very recently. The rarity of computational...

Featured image by Nino Carè from PixabayThe Swiss Army Chainsaw that is Perl may not be a hot, new language, but it is a powerhouse still for text processing. I learned Perl to work with text in the form of log...

Planning to stay at Airbnb on your next Tokyo visit? Catch a glimpse of what the surroundings look like and see other similar areas — a data project.PrefaceDespite rising tension with the government authority in...

One of the most important statistical methods for data scientistsPicture created by myself, Terence Shin, and FreepikA/B testing is one of the most important concepts in data science and in the tech world in general...