source&pool
A daily wire of long-form journalism, video, and discourse — filed, tagged, and laid out flat.
VOL. I·NO. 01
WEDNESDAY, SEPTEMBER 16, 2026
Hacker News3697X 主题热门3593MacRumors79CNBC74YahooFinance649to5Mac60Kotaku44Verge43IGN339to5Google32Gematsu32aihot31NintendoLife30Engadget26Eurogamer25TechCrunch25BusinessInsider23Guardian20CNET15NBC15NPR15FoxBusiness14Polygon14Fortune13SeekingAlpha13bgr12Gizmodo12CBS11Wccftech11Investor'sBusinessDaily10Mashable10PushSquare10TechPowerUp10USAToday10WIRED10CNN8NintendoEverything8Notebookcheck8NewYorkPost8CrudeOilPricesToday8VideoGamesChronicle8ABC7ArsTechnica7Fox7GameInformer7WindowsCentral7BleepingComputer6AppleInsider5Deadline5DigitalFoundry5GamesIndustry.biz5PetaPixel5Variety5Yahoo5AlJazeera4AndroidPolice4DroidLife4MotleyFool4GameRant4Jalopnik4PureXbox4SamMobile4SlashGear4Hacker4AP3CanonRumors3ChromeUnboxed3CoinDesk3GameDeveloper3GSMArena3Motor13Blizzard3XBOXWire3PCMag3PCWorld3SeattleTimes3Space3Register3TweakTown3YGOrganization3ZDNET324/7WallSt.2Aftermath2AndroidCentral2AwfulAnnouncing2BleedingCool2BuzzFeed2CTech2DigitalCameraWorld2DualShockers2DW2EventHubs2Futurism2Hodinkee2Independent2Lifehacker2MassivelyOverpowered2MyNintendo2Nature2Newser2Newsweek2PaulKrugman2PokémonGOHub2RoadtoVR2RPGSite2Conversation2Intercept2NextWeb2Tom'sGuide2UploadVR2VideoCardz2WarhammerCommunity2WindowsLatest2YourTango2404Media143rumors1ABC111AboveLaw1ageofempires1AndroidHeadlines1AOL1AVClub1Benzinga1BikeRadar1Billboard1BloodyDisgusting1Borderlands1Bungie1Yahoo!FinanceCanada1CineD1CnEVPost1comicbook1CreativeBloq1CyberSecurityNews1DailyKos1DCRainmaker1derekthompson1Draftsim1CNN1Euronews1flatpanelshd1FrequentMiler1GAMINGbible1garymarcus.substack1GearPatrol1GeekWire1GeekyGadgets1Hackaday1HollywoodReporter1InsiderGaming1InterconnectsAI1InterestingEngineering1JapanTimes1KITCO1KrebsonSecurity1KSL1LosAngelesTimes1Lloyd'sList1WPLGLocal101Macworld1Maxroll1Mediaite1MiddleEastEye1MonochromeWatches1MPR1SemiAnalysis1Newsshooter1NoMan'sSky1nylon.com.sg1NYT1OregonLive1PCGamesN1PersonaCentral1Pokemon1politico.eu1PittsburghPost-Gazette1QuantaMagazine1qz1RockPaperShotgun1SammyGuru1ScienceAlert1ScientificAmerican1SouthChinaMorningPost1Semafor1SFGATE1YahooFinanceSingapore1YahooSingapore1SportsIllustrated1SimpleFlying1Sources1supercarblondie1Tedium1TelecomTalk1GameBusiness1TheGamer1Times1LongmontTimes-Call1TmoNews1TopGear1TwistedVoxel1YahooFinanceUK1UnHerd1vox1WhatHi-Fi?1WPBF1WRAL1
  1. 001Hacker NewsSEP · 09English

    Robots-check: see what your robots.txt is serving (Cloudflare AI Crawl Control)

    robots-check is a Node.js tool that fetches and analyzes a site's live robots.txt file, revealing whether Cloudflare's AI Crawl Control feature is injecting additional rules and showing which search engines and AI bots are allowed or blocked. The tool requires no API keys or signup and uses only Node's built-in https module.

    By Janibert1