The challenge
Our organization used multiple recruiting platforms (10th Street and UKG), creating fragmented data across different APIs and formats. We needed to:
- Unify job listings from multiple sources
- Keep our WordPress careers page automatically updated
- Deliver fast, reliable API performance
- Avoid managing servers and infrastructure
The solution
We built a fully serverless platform on Google Cloud:
Architecture
10th Street API ──┐
├──> Cloud Function (Sync) ──> BigQuery ──> Cloud Function (API) ──> WordPress
UKG API ──────────┘
key Components
1. Automated Sync
- Cloud Scheduler triggers hourly job fetches
- Transformers convert each API format to unified schema
- UPSERT strategy manages full job lifecycle
2. BigQuery as Database
- Serverless, auto-scaling storage
- Lightning-fast queries for search/filtering
- Cost-effective pay-per-query model
3. Production-Ready API
- Bearer token authentication
- Rate limiting (100 req/min)
- Pagination, multi-filter support, full-text search
- <500ms average response time
4. Laravel-Style Migrations Built custom migration system for BigQuery schema management with version control and rollback capability.
5. CI/CD Pipeline GitHub Actions auto-deploys on push to main, zero-downtime releases.
The results
Business Impact
- Zero manual data entry
- No infrastructure to manage
- Auto-scaling handles traffic spikes
- Fresh job data within 1 hour
Tech Stack: Node.js 20, TypeScript, Google Cloud Functions, BigQuery, Express.js
0
+
jobs from 2 sources
0
%
uptime
0
ms
API response time