Data Processing

How are open LLMs trained and created in 2024? 🤔 @01AI_Yi just released their paper on how they created the YI, a family of LLMs and V-LLMs. The paper includes details on the data...

Philipp Schmid

@_philschmid

ChatGPT is the best partner for data processing with its latest update. You can search for data on the web, exploit it with the Code Interpreter and export it in Excel format easi...

Paul Couvert

@itsPaulAi

Excel and ChatGPT are the best combo. You can automate your data processing easily. I show you how to use AI with Excel without typing formulas: https://t.co/b32SKkwddr

Paul Couvert

@itsPaulAi

Extract tables from documents using @llama_index UnstructuredElementParser and then use RecursiveRetriever to enable hybrid tabular/semantic queries and also comparisons over multi...

Rohan

@clusteredbytes

PyTorch 101: Dataset Class clearly explained! Understanding the Dataset Class is crucial for efficiently managing & preprocessing your data while building models in PyTorch! Toda...

Akshay 🚀

@akshay_pachaar

Data processing is not always straightforward Then how is Data Processed in the Cloud Ecosystem? /🧵/

Sasi 📊📈

@freest_man

Starting with @AlchemyLearn

Ojas Aklecha

@ojasaklecha

If you’re building “chat over your PDFs” with LLMs, you need to deal with the pesky issue of how to parse embedded tables/diagrams. Native text splitting + top-k on your tables ==...

Jerry Liu

@jerryjliu0

What is under the hood of 𝗦𝗽𝗮𝗿𝗸? Apache Spark is an extremely popular distributed processing framework utilizing in-memory processing to speed up task execution. Most of its libra...

Aurimas Griciūnas

@Aurimas_Gr

What is under the hood of 𝗔𝗽𝗮𝗰𝗵𝗲 𝗙𝗹𝗶𝗻𝗸? 𝗦𝘁𝗿𝗲𝗮𝗺 𝗣𝗿𝗼𝗰𝗲𝘀𝘀𝗶𝗻𝗴 is becoming more important and accessible to all organisations. One of the most popular Stream Processing Frameworks used...

Aurimas Griciūnas

@Aurimas_Gr

Got asked how stream processing platforms (e.g. Apache Flink, Kafka Streams, Spark Structured Streaming) compare to streaming databases (e.g. RisingWave, Materialize, PranaDB). The...

Gunnar Morling 🌍

@gunnarmorling

Machine Learning models are sneaky little bastards that use any available shortcuts to optimize their evaluation metric. Every tutorial speaks about splitting your data randomly....

Santiago

@svpino

I have tried hundreds of AI tools. Here are 23 great ones that are not just GPT4. 1. CatBird - Run one prompt on 16+ Stable Diffusion models. https://t.co/q2rGDwyXFg https://t...

Josh Dance

@JoshDance

4 text functions to learn in less than 5 minutes:

Excel Dictionary

@exceldictionary

10 Skills Employers Want To See In Your Data Analytics Portfolio:

Brian Graves

@NewPrediction

⌨️💡 What is #Scala programming lang? - Scala is used in Data processing, distributed computing, and web development. It powers the data engineering infrastructure of many companie...

📰 HackNewzified 📰

@Hacknewzified

5 challenges faced when dealing with big data: https://t.co/D4mZcj7x92

Justine

@JustineCloudDev

7 GitHub repositories will make you a standout developer from 99% of people:

Pratham

@Prathkum

4 text functions you need to know:

Excel Dictionary

@exceldictionary

5 machine learning tricks to make your life easy. (A thread) 🧵👇

Shubham Saboo

@Saboo_Shubham_

5 simple tricks to supercharge your machine learning development. (A thread) 👇

Shubham Saboo

@Saboo_Shubham_

Dealing with common problems in Machine Learning data 👇🧵

Jaydeep

@_jaydeepkarale

Here is what Machine Learning tutorials told you to do: 1. Start by transforming your dataset 2. Then split it (train, validation, and test sets) 3. Finally, build your model Ple...

Santiago

@svpino

We just published a YouTube video that explains why is Kafka fast. If you prefer video format, consider subscribing to our ByteByteGo youtube channel: https://t.co/Abm5CkdvPE I...

Alex Xu

@alexxubyte