Hacker News and HTTP Request integration

Description This workflow automates the process of scraping the latest discussions from HackerNews, transforming raw threads into human readable content using Google Gemini, and exporting the final content into a well-formatted Google Doc. Overview This n8n workflow is responsible for extracting trending posts from the HackerNews API. It loops through each item, performs HTTP data extraction, utilizes Google Gemini to generate human-readable insights, and then exports the enriched content into Google Docs for distribution, archiving, or content creation. Who this workflow is for Tech Newsletter Writers**: Automate the collection and summarization of trending HackerNews posts for inclusion in weekly or daily newsletters. Content Creators & Bloggers**: Quickly generate structured summaries and insights from HackerNews threads to use as inspiration or supporting content for blog posts, videos, or social media. Startup Founders & Product Builders**: Monitor HackerNews for discussions relevant to your niche or competitors, and keep a pulse on the community’s opinions. Investors & Analysts**: Surface early signals from the tech ecosystem by identifying what’s trending and how the community is reacting. Researchers & Students**: Analyze popular discussions and emerging trends in technology, programming, and startups—enriched with AI-generated insights. Digital Agencies & Consultants**: Offer HackerNews monitoring and insight reports as a value-added service to clients interested in the tech space. Tools Used n8n**: The core automation engine that manages the trigger, transformation, and export. HackerNews API**: Provides access to trending or new HN posts. Google Gemini**: Enriches HackerNews content with structured insights and human-like summaries. Google Docs**: Automatically creates and updates a document with the enriched content, ready for sharing or publishing. How to Install Import the Workflow**: Download the .json file and import it into your n8n instance. Set Up HackerNews Source**: Choose whether to use the HN API (via HTTP Request node) or RSS Feed node. Configure Gemini API**: Add your Google Gemini API key and design the prompt to extract pros/cons, key themes, or insights. Set Up Google Docs Integration**: Connect your Google account and configure the Google Docs node to create/update a document. Test and Deploy**: Run a test job to ensure data flows correctly and outputs are formatted as expected. Use Cases Tech Newsletter Authors**: Generate ready-to-use summaries of trending HackerNews threads. Startup Founders**: Stay informed on key discussions, product launches, and community feedback. Investors & Analysts**: Spot early trends, technical insights, and startup momentum directly from HN. Researchers**: Track community reactions to new technologies or frameworks. Content Creators**: Use the enriched data to spark blog posts, YouTube scripts, or LinkedIn updates. Connect with Me Email: [email protected] LinkedIn: https://www.linkedin.com/in/ranjan-dailata/ Get Bright Data: Bright Data (Supports free workflows with a small commission) #n8n #automation #hackernews #contentcuration #aiwriting #geminiapi #googlegemini #techtrends #newsletterautomation #googleworkspace #rssautomation #nocode #structureddata #webscraping #contentautomation #hninsights #aiworkflow #googleintegration #webmonitoring #hnnews #aiassistant #gdocs #automationtools #gptlike #geminiwriter

Hacker News to Video Content Overview This workflow converts trending articles from Hacker News into engaging video content. It integrates AI-based tools to analyze, summarize, and generate multimedia content, making it ideal for content creators, educators, and marketers. Features Article Retrieval: Pulls trending articles from Hacker News. Limits the number of articles to process (configurable). Content Analysis: Uses OpenAI's GPT model to: Summarize articles. Assess their relevance to specific topics like automation or AI. Extract key image URLs. Image and Video Generation: Leonardo.ai: Creates stunning AI-generated images based on extracted prompts. RunwayML: Converts images into high-quality videos. Structured Content Creation: Parses content into structured formats for easy reuse. Generates newsletter-friendly blurbs and social media-ready captions. Cloud Integration: Uploads generated assets to: Dropbox Google Drive Microsoft OneDrive MinIO Social Media Posting (Optional): Supports posting to YouTube, X (Twitter), LinkedIn, and Instagram. Workflow Steps Trigger Initiated manually via the "Test Workflow" button. Fetch Articles Retrieves articles from Hacker News. Limits the results to avoid processing overload. Content Filtering Evaluates if articles are related to AI/Automation using OpenAI's language model. Image and Video Generation Generates: AI-driven image prompts via Leonardo.ai. Videos using RunwayML. Asset Management Saves the output to cloud storage services or uploads directly to social media platforms. Prerequisites API Keys**: Hacker News OpenAI Leonardo.ai RunwayML Creatomate n8n Installation**: Ensure n8n is installed and configured locally or on a server. Credentials**: Set up credentials in n8n for all external services used in the workflow. Customization Replace Hacker News with any other data source node if needed. Configure the "Article Analysis" node for different topics. Adjust the cloud storage services or add custom storage options. Usage Import this workflow into your n8n instance. Configure your API credentials. Trigger the workflow manually or schedule it as needed. Check the outputs in your preferred cloud storage or social media platform. Notes Extend this workflow further by automating social media posting or newsletter integration. For any questions, refer to the official documentation or reach out to the creator. About the Creator This workflow was built by AlexK1919, an AI-native workflow automation architect. Check out the overview video for a quick demo. Tools Used Leonardo.ai** RunwayML** Creatomate** Hacker News API** OpenAI GPT** Feel free to adapt and extend this workflow to meet your specific needs! 🎉

This n8n template is one of a 3-part series exploring use-cases for clustering vector embeddings: Survey Insights Customer Insights Community Insights This template demonstrates the Community Insights scenario where HN commments can be quickly grouped by similarity and an AI agent can generate insights on those groupings. With this workflow, Researchers or HN users can quickly breakdown community consensus on a particular topic and identify frequently mentioned positives and negatives. Sample Output: https://docs.google.com/spreadsheets/d/e/2PACX-1vQXaQU9XxsxnUIIeqmmf1PuYRuYtwviVXTv6Mz9Vo6_a4ty-XaJHSeZsptjWXS3wGGDG8Z4u16rvE7l/pubhtml How it works HN comments are imported via the Hacknews API node. Comments are then inserted into a Qdrant collection carefully tagged with the Hackernews API metadata. Comments are then fetched and are put through a clustering algorithm using the Python Code node. The Qdrant points are returned in clustered groups. Each group is looped to fetch the payloads of the points and feed them to the AI agent to summarise and generate insights for. The resulting insights and raw responses are then saved to the Google Spreadsheet for further analysis by the researcher or the HN user. Requirements Works best with lots of comments! Qdrant Vectorstore for storing embeddings. OpenAI account for embeddings and LLM. Customising the Template Adjust clustering parameters which make sense for your data. Adjust sentimentality setting if comments are overwhelmingly negative at times.

Learning something new? Endlessly searching to find the best resources? This workflow finds top community-recommended learning resources on any topic from Hacker News, delivered to your inbox. How it works User submits a topic they want to learn via a simple form. The workflow searches for relevant "Ask HN" posts on Hacker News and extracts top-level comments. An LLM analyzes the comments and identifies the best learning resources. A personalized email is sent to the user with a Markdown formatted list of top recommendations, categorized by resource type (e.g., book, course, article) and difficulty level. Set up steps Add your Google Gemini API credentials. You'll need to create a project and enable the Generative Language API. Add your SMTP credentials for sending emails. Customize the Form and email subject (optional) Activate the workflow Screenshots for Workflow, Form and Email Built on Day-03 as part of the #100DaysOfAgenticAi Fork it, tweak it, have fun!

Daily AI News Digest from Hacker News with GPT Summaries and Email Delivery Automate your daily AI news briefing: fetch AI-tagged stories from Hacker News, filter for the last 24 hours, scrape and summarize with GPT, then deliver a clean HTML email digest—no manual curation needed. What It Does Runs on schedule to fetch up to 1000 Hacker News stories tagged "AI", filters for today's posts, loops through each to scrape content from source URLs, generates concise AI summaries via OpenAI GPT, aggregates into a styled HTML newsletter, and sends via email. Setup Requirements Credentials Needed: OpenAI API Key**: Get from platform.openai.com/api-keys, add as "OpenAI" credential in n8n SMTP Server**: Configure email credentials (Gmail, Zoho, etc.) in n8n's SMTP settings Configuration Steps: Import workflow JSON into n8n Add OpenAI credential to "GPT 5 pro" node Add SMTP credential to "Send email" node Update fromEmail and toEmail fields in "Send email" node Set schedule in "start" trigger node (default: daily) Activate workflow Key Features Smart Filtering**: Fetches 1000 stories, filters last 24 hours using date expressions AI Summarization**: GPT generates heading + 2-sentence summaries with links Reliable Scraping**: HTTP requests with markdown conversion for clean LLM input Batch Processing**: Loops through items, processes sequentially Responsive Design**: Mobile-friendly HTML email template with inline CSS Aggregation**: Combines all summaries into single digest Customization Options Change Keywords**: Modify "AI" filter in "Get many items" node Adjust Timeframe**: Edit date filter in "Today" node Tweak Summaries**: Customize GPT prompt in "News Summary Agent" node Email Styling**: Update HTML/CSS in "Send email" node Schedule**: Change frequency in "start" trigger Use Cases Personal daily AI briefings for researchers/developers Team knowledge sharing via automated newsletters Content curation for blogs or social media Trend monitoring for marketers Troubleshooting No stories returned**: Check HN API limits, verify keyword filter Scraping failures**: Some sites block bots—proxy noted in workflow but may need updates Email not sending**: Verify SMTP credentials and test connection Poor summaries**: Adjust GPT prompt or switch model Execution Time: 2-10 minutes depending on story count