source&pool
A daily wire of long-form journalism, video, and discourse — filed, tagged, and laid out flat.
VOL. I·NO. 01
WEDNESDAY, SEPTEMBER 16, 2026
Hacker News3726X 主题热门3614MacRumors79CNBC75YahooFinance649to5Mac61Kotaku44Verge43IGN339to5Google32Gematsu32aihot31NintendoLife30Engadget26Eurogamer25TechCrunch25BusinessInsider23Guardian20NBC16CNET15NPR15FoxBusiness14Polygon14Fortune13SeekingAlpha13bgr12Gizmodo12CBS11Wccftech11Investor'sBusinessDaily10Mashable10PushSquare10TechPowerUp10USAToday10WIRED10CNN8NintendoEverything8Notebookcheck8NewYorkPost8CrudeOilPricesToday8VideoGamesChronicle8ABC7ArsTechnica7Fox7GameInformer7WindowsCentral7BleepingComputer6PetaPixel6AppleInsider5Deadline5DigitalFoundry5GamesIndustry.biz5Variety5Yahoo5AlJazeera4AndroidPolice4DroidLife4MotleyFool4GameRant4Jalopnik4PureXbox4SamMobile4SlashGear4Hacker4AP3CTech3CanonRumors3ChromeUnboxed3CoinDesk3GameDeveloper3GSMArena3Motor13Blizzard3XBOXWire3PCMag3PCWorld3SeattleTimes3Space3Register3TweakTown3YGOrganization3ZDNET324/7WallSt.2Aftermath2AndroidCentral2AwfulAnnouncing2BleedingCool2BuzzFeed2DigitalCameraWorld2DualShockers2DW2EventHubs2Futurism2Hodinkee2Independent2Lifehacker2MassivelyOverpowered2MyNintendo2Nature2Newser2Newsweek2PaulKrugman2PokémonGOHub2RoadtoVR2RPGSite2Conversation2Intercept2NextWeb2Tom'sGuide2UploadVR2VideoCardz2WarhammerCommunity2WindowsLatest2YourTango2404Media143rumors1ABC111AboveLaw1ageofempires1AndroidHeadlines1AOL1AVClub1Benzinga1BikeRadar1Billboard1BloodyDisgusting1Borderlands1Bungie1Yahoo!FinanceCanada1CineD1CnEVPost1comicbook1CreativeBloq1CyberSecurityNews1DailyKos1DCRainmaker1derekthompson1Draftsim1CNN1Euronews1flatpanelshd1FrequentMiler1GAMINGbible1garymarcus.substack1GearPatrol1GeekWire1GeekyGadgets1Hackaday1HollywoodReporter1InsiderGaming1InterconnectsAI1InterestingEngineering1JapanTimes1KITCO1KrebsonSecurity1KSL1LosAngelesTimes1Lloyd'sList1WPLGLocal101Macworld1Maxroll1Mediaite1MiddleEastEye1MonochromeWatches1MPR1SemiAnalysis1Newsshooter1NoMan'sSky1nylon.com.sg1NYT1OregonLive1PCGamesN1PersonaCentral1Pokemon1politico.eu1PittsburghPost-Gazette1QuantaMagazine1qz1RockPaperShotgun1SammyGuru1ScienceAlert1ScientificAmerican1SouthChinaMorningPost1Semafor1SFGATE1YahooFinanceSingapore1YahooSingapore1SportsIllustrated1SimpleFlying1Sources1supercarblondie1Tedium1TelecomTalk1GameBusiness1TheGamer1Times1LongmontTimes-Call1TmoNews1TopGear1TwistedVoxel1YahooFinanceUK1UnHerd1vox1WhatHi-Fi?1WPBF1WRAL1
  1. 001Hacker NewsSEP · 09English

    Robots-check: see what your robots.txt is serving (Cloudflare AI Crawl Control)

    robots-check is a Node.js tool that fetches and analyzes a site's live robots.txt file, revealing whether Cloudflare's AI Crawl Control feature is injecting additional rules and showing which search engines and AI bots are allowed or blocked. The tool requires no API keys or signup and uses only Node's built-in https module.

    By Janibert1