Web Scraping and API Schema Embedding Pipeline
When clicking ‘Test workflow’
0msWeb Search For API Schema
api.apify.com
437msScrape Webpage Contents
api.apify.com
69msResults to List
splitOut
0msRecursive Character Text Splitter1
noOp
0msContent Chunking @ 50k Chars
0msSplit Out Chunks
splitOut
0msDefault Data Loader
noOp
0msSet Embedding Variables
0msExecute Workflow Trigger
0msExecution Data
executiondata
251msEventRouter
0msGoogle Gemini Chat Model
google
25788msSuccessful Runs
filter
0msFor Each Document...
noOp
0msEmbeddings Google Gemini
noOp
0msHas API Documentation?
openai
26365msStore Document Embeddings
noOp
0msEmbeddings Google Gemini1
noOp
0msGoogle Gemini Chat Model1
google
25835msExtract API Operations
openai
25805msSearch in Relevant Docs
noOp
0msWait
noOp
0msRemove Dupes
removeDuplicates
0msFilter Results
filter
0msResearch
noOp
0msHas Results?
0msResponse Empty
0msResponse OK
0msCombine Docs
aggregate
0msTemplate to List
splitOut
0msQuery Templates
0msGoogle Gemini Chat Model2
google
25787msFor Each Template...
noOp
0msQuery & Docs
0msIdentify Service Products
openai
25884msExtract API Templates
0msEmbeddings Google Gemini2
noOp
0msSearch in Relevant Docs1
noOp
0msCombine Docs1
aggregate
0msQuery & Docs1
0msFor Each Template...1
noOp
0msMerge Lists
3msRemove Duplicates
removeDuplicates
0msAppend Row
googleSheets
155msResponse OK1
0msHas Operations?
0msResponse Empty1
0msResearch Pending
googleSheets
149msResearch Result
googleSheets
137msResearch Error
googleSheets
151msExtract Pending
googleSheets
141msResearch Event
0msExtract Event
0msExtract
noOp
0msExtract Result
googleSheets
152msExtract Error
googleSheets
150msGet API Operations
googleSheets
142msContruct JSON Schema
4msUpload to Drive
googleDrive
556msSet Upload Fields
0msResponse OK2
0msGenerate Event
0msGenerate Pending
googleSheets
148msGenerate
noOp
0msGenerate Error
googleSheets
148msGenerate Result
googleSheets
153msGet All Extract
googleSheets
143msGet All Research
googleSheets
308msFor Each Research...
noOp
0msFor Each Extract...
noOp
0msWait1
noOp
0msAll Research Done?
0msAll Extract Done?
0msGet All Generate
googleSheets
136msAll Generate Done?
0msFor Each Generate...
noOp
0msWait2
noOp
0msHas Results?1
0msResponse Scrape Error
0msHas Results?3
0msResponse No API Docs
0msPress enter or space to select a node. You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.
Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.