Be Our Guest
Interested in being a guest on The Data Flowcast? Fill out the form and we will be in touch.
The shift from simple cron jobs to orchestrated AI-powered workflows is reshaping how startups scale. For a small team, these transitions come with unique challenges and big opportunities.
In this episode, we are joined by Naseem Shah, Head of Engineering at XENA Intelligence, who shares how he built data pipelines from scratch, adopted Apache Airflow and transformed Amazon review analysis with LLMs.
Key Takeaways:
00:00 Introduction.
03:28 The importance of building initial products that support growth and investment.
06:16 The process of adopting new tools to improve reliability and efficiency.
09:29 Approaches to learning complex technologies through practice and fundamentals.
13:57 Trade-offs small teams face when balancing performance and costs.
18:40 Using AI-driven approaches to generate insights from large datasets.
22:38 How unstructured data can be transformed into actionable information.
25:55 Moving from manual tasks to fully automated workflows.
28:05 Orchestration as a foundation for scaling advanced use cases.
Resources Mentioned:
Embed Codes:
Hosting Embed Code
<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless src="https://player.cohostpodcasting.com/059c559e-278c-49e8-9f1a-2fb768d19c77/5b8c83e0-771c-4add-a8a7-c39ebbe39bdf"></iframe>
iTunes Embed Code
<iframe allow="autoplay *; encrypted-media *; fullscreen *; clipboard-write" frameborder="0" height="175" style="width:100%;max-width:660px;overflow:hidden;border-radius:10px;" sandbox="allow-forms allow-popups allow-same-origin allow-scripts allow-storage-access-by-user-activation allow-top-navigation-by-user-activation" src="https://embed.podcasts.apple.com/us/podcast/transforming-data-pipelines-at-xena-intelligence-with/id1337349579?i=1000732121395"></iframe>
Spotify Embed Code
<iframe data-testid="embed-iframe" style="border-radius:12px" src="https://open.spotify.com/embed/episode/7KdmLXy7t9rYrlS4492FNf?utm_source=generator&t=0" width="100%" height="152" frameBorder="0" allowfullscreen="" allow="autoplay; clipboard-write; encrypted-media; fullscreen; picture-in-picture" loading="lazy"></iframe>
Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
Interested in being a guest on The Data Flowcast? Fill out the form and we will be in touch.
Try Astro today and get up to $20 in free credits during your 14-day trial.