Shubham Saboo
Shubham Saboo

@Saboo_Shubham_

9 Tweets Jan 11, 2023
Ever wondered what it takes to build a Google-like search? ๐Ÿค”
๐Ÿ•น @JinaAI_ CLIP-as-service and 10 lines of #Python code is all you need!
๐Ÿคฏ Yes, you heard it right!
Let's look at how you can build a Text-to-image cross-modal search in this ๐Ÿงต
#nlproc #OpenSource #AI #Google
@JinaAI_ What is Cross-Modal Search?
๐Ÿ‘‰ Cross-modal search systems let you search for information through multiple modalities. This can include searching for images using text queries or vice-versa.
@Google's text-to-image search is an example of cross-modal search we use frequently!
@JinaAI_ @Google Cross-modal search applications are taking the world by a storm making it easier to find relevant information from the beast called internet.
Let's look at what is possible with cross-modal search with a simple example powered by #jinaNOW๐Ÿ‘‡
Building a text-to-image search requires @JinaAI_ CLIP-as-service and DocArray library with a few lines of #Python code.
Check out my blog for a step-by-step guide to build a cross-modal search for Totally Looks Like dataset ๐Ÿ‘‡
medium.com
@JinaAI_ To give you a glimpse of what the cross-modal search system that you built can do โœจ
We are going to input some English sentences and view the top-9 matching images ๐Ÿ•น
Check out the results ๐Ÿ‘‡
@JinaAI_ To understand how the @OpenAI #CLIP embeddings work for different data types and play around with it. Check out ๐Ÿ‘‡
CLIP-as-service is not just limited to building text-to-image search. It can very easily be reversed to build an image-to-text search!
๐Ÿ‘‰ Given a query image find the sentence that best describes the image.
Example ๐Ÿ‘‡
#Python #AI #nlproc #OpenSource #LowCode
To know more about the exciting world of neural search, check out ๐Ÿ‘‰
๐Ÿ“š @JinaAI_ Learning Bootcamp - learn.jina.ai
๐Ÿ“œ DocArray Docs - docarray.jina.ai
๐Ÿ“’ CaS Docs - clip-as-service.jina.ai
๐Ÿ“ Jina Blogs - medium.com
#learn #code #community
Signing off โœ๏ธ
If you enjoyed this one:
1. Please hit RT!
2. Follow me at @Saboo_Shubham_ for frequent updates on #ai, #search, and #nocode ๐Ÿ™

Loading suggestions...