Under the hood for NSW Independent Liquor and Gaming Authority

More of the gory details of how information gets into PlanningAlerts. This is here so you can see and learn how it's done but also so you are able to fix things and see in detail what isn't working.

The steps to getting data into Planning Alerts

  1. Applications are published on the NSW Independent Liquor and Gaming Authority website in a human readable, non-structured form.
  2. The latest scraper code on Github is loaded by our scraping platform morph.io.
  3. The scraper planningalerts-scrapers/nsw_office_of_liquor_gaming_and_racing on our scraping platform morph.io collects the information daily and converts it into a machine-readable format.
  4. If the scraper errors anyone who is watching the scraper on morph.io gets informed via a daily email alert.
  5. The machine readable data is validated, imported and geocoded by PlanningAlerts daily. If there are any validation errors on an application, the application is skipped and the error is logged. See below for the most recent logs.
  6. The information is published on PlanningAlerts, made available via the API, and people are informed of new applications via email alerts.

Most recent import logs

Error 400 Bad Request while trying to save application 1-9319319442 for NSW Independent Liquor and Gaming Authority, NSW. So, skipping
Error 400 Bad Request while trying to save application 1-9315631131 for NSW Independent Liquor and Gaming Authority, NSW. So, skipping
Error 400 Bad Request while trying to save application 1-9307282081 for NSW Independent Liquor and Gaming Authority, NSW. So, skipping
Error 400 Bad Request while trying to save application SR0001339749 for NSW Independent Liquor and Gaming Authority, NSW. So, skipping
Error 400 Bad Request while trying to save application SR0001337509 for NSW Independent Liquor and Gaming Authority, NSW. So, skipping
473 applications found for NSW Independent Liquor and Gaming Authority, NSW with date from 2024-12-19
5 applications errored for NSW Independent Liquor and Gaming Authority, NSW with date from 2024-12-19
Took 8 s to import applications from NSW Independent Liquor and Gaming Authority, NSW

What you can do next

If something isn't right with the scraper or the data coming in then you could do one or several of the following:

If everything is working fine right now but you want to help if something goes wrong:

  • Watch the scraper on morph.io, so you will get an email if it errors. Press the "Watch" button in the top right while you're logged in to morph.io.
  • View any scraper issues. Help fix them or comment on them if they are out of date