Posted on Aug 03, 2021

Predicting the arrival (on-time, lead time) of carriers to a location System

Challenges

  • The client onboards customers frequently and each customer onboarded needs a data extract as well as on-time and lead-time rules setup in their data warehouse. Each extract needed a new package to be written
  • Existing ETL packages needed changes for new requirements or additions for new customers
  • The current DWH processes were outdated and needed process improvements

Solutions

  • Created views, packages and shell scripts to provide data extracts for customers on a daily, weekly or monthly basis as per the requirements
  • Created packages with on-time and lead-time rules and logic to estimate whether carriers are on time or late to the location
  • Made changes to the existing ETL packages and created new ones wherever required
  • Wrote a generic package which can be used by all extracts to save time and effort