Aurimas Griciลซnas

Aurimas Griciลซnas

@Aurimas_Gr

Founder & CEO at SwirlAI ๐Ÿ“– I tweet daily about #MLOps, #DataEngineering, #MachineLearning, #DataScience and #Data โœ๏ธ Author of SwirlAI Newsletter.

Lithuania t.co Joined Jun 2012
7
Threads
1
views
7.1K
Followers
2.1K
Tweets

Threads

What is under the hood of ๐—ฆ๐—ฝ๐—ฎ๐—ฟ๐—ธ? Apache Spark is an extremely popular distributed processing framework utilizing in-memory processing to speed up task execution. Most of its libra...

How is ๐—–๐—œ/๐—–๐—— ๐—ฝ๐—ฟ๐—ผ๐—ฐ๐—ฒ๐˜€๐˜€ ๐—ฑ๐—ถ๐—ณ๐—ณ๐—ฒ๐—ฟ๐—ฒ๐—ป๐˜ ๐—ณ๐—ผ๐—ฟ ๐— ๐—ฎ๐—ฐ๐—ต๐—ถ๐—ป๐—ฒ ๐—Ÿ๐—ฒ๐—ฎ๐—ฟ๐—ป๐—ถ๐—ป๐—ด ๐—ฃ๐—ฟ๐—ผ๐—ท๐—ฒ๐—ฐ๐˜๐˜€ compared to ๐—ฅ๐—ฒ๐—ด๐˜‚๐—น๐—ฎ๐—ฟ ๐˜€๐—ผ๐—ณ๐˜๐˜„๐—ฎ๐—ฟ๐—ฒ? The important difference that the Machine Learning aspect of the projects brings to the...

What are the most common ๐—จ๐˜€๐—ฒ ๐—–๐—ฎ๐˜€๐—ฒ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ž๐—ฎ๐—ณ๐—ธ๐—ฎ? We have covered lots of concepts around Kafka already. But what are the most common use cases for The System that you are very likely...

What is under the hood of ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ? ๐—ฆ๐˜๐—ฟ๐—ฒ๐—ฎ๐—บ ๐—ฃ๐—ฟ๐—ผ๐—ฐ๐—ฒ๐˜€๐˜€๐—ถ๐—ป๐—ด is becoming more important and accessible to all organisations. One of the most popular Stream Processing Frameworks used...

Some thoughts on ๐—ฅ๐—ฒ๐—ฎ๐—ฑ๐—ถ๐—ป๐—ด ๐——๐—ฎ๐˜๐—ฎ from ๐—ž๐—ฎ๐—ณ๐—ธ๐—ฎ. Kafka is an extremely important ๐——๐—ถ๐˜€๐˜๐—ฟ๐—ถ๐—ฏ๐˜‚๐˜๐—ฒ๐—ฑ ๐— ๐—ฒ๐˜€๐˜€๐—ฎ๐—ด๐—ถ๐—ป๐—ด ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ to understand, last time we covered Writing Data. ๐—ฆ๐—ผ๐—บ๐—ฒ ๐—ฟ๐—ฒ๐—ณ๐—ฟ๐—ฒ๐˜€๐—ต๐—ฒ๐—ฟ๐˜€: โžก๏ธ Clie...

What are the most common ๐—จ๐˜€๐—ฒ ๐—–๐—ฎ๐˜€๐—ฒ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ž๐—ฎ๐—ณ๐—ธ๐—ฎ? We have covered lots of concepts around Kafka already. But what are the most common use cases for The System that you are very likely...

Every #DataEngineer should know what Spark Shuffle is and why it happens. Get more info here: https://t.co/oWhazlzkLX Or read on in the thread ๐Ÿ‘‡ Also subscribe to my newsletter...