How AI Recipe Extraction Works
When you paste a TikTok link into Nibbley and get a perfectly formatted recipe card back, it might feel like magic. But behind the scenes, there’s some fascinating AI technology making it happen.
The Challenge
Recipe content comes in wildly different formats:
- Videos where ingredients are mentioned verbally
- Images with recipe text overlaid
- Blog posts buried under paragraphs of life stories
- Social media captions with inconsistent formatting
- Handwritten recipe cards from your grandmother
A traditional web scraper can handle a well-structured recipe blog, but it completely fails with video content, images, and informal social media posts. That’s where AI comes in.
How It Works
Step 1: Content Identification
When you share a link, Nibbley first determines what type of content it is. A TikTok video needs different processing than a recipe blog. Our system identifies the source and chooses the right extraction pipeline.
Step 2: Content Analysis
For videos, the AI analyses multiple signals:
- Speech recognition to capture spoken ingredients and instructions
- Visual recognition to identify ingredients shown on screen
- On-screen text reading (OCR) for displayed recipe details
For web pages, the AI looks for:
- Schema.org recipe markup (the gold standard)
- Common recipe plugin formats
- Unstructured text that contains recipe-like content
For images, the AI uses:
- Optical Character Recognition (OCR) to read text
- Visual understanding to identify food items
Step 3: Structuring
Raw extracted text needs to be structured into a proper recipe format. The AI identifies:
- Ingredients — distinguishing between ingredient names, quantities, and preparation notes
- Steps — ordering instructions logically
- Metadata — cooking time, serving size, difficulty level, cuisine type
Step 4: Quality Check
Before presenting the recipe, the AI runs several quality checks:
- Are the ingredient quantities reasonable?
- Do the steps make logical sense?
- Is any critical information missing?
Accuracy and Limitations
No AI system is perfect. Our extraction accuracy varies by source:
- Structured recipe websites: 95%+ accuracy
- Social media captions: 85-90% accuracy
- Video content: 80-90% accuracy
- Handwritten recipes: 75-85% accuracy
That’s why Nibbley always lets you review and edit extracted recipes before saving. The AI does the heavy lifting, and you make the final call.
The Future
AI recipe extraction is improving rapidly. We’re working on features like automatic nutritional calculation, allergen detection, and recipe scaling — all powered by the same AI technology that makes saving recipes so effortless today.