# Lead Data Engineer - R01553055 at Brillio

Lead Data Engineer - R01553055 at Brillio in Bangalore, Karnataka, India. Hybrid. Posted July 17, 2025.

- Company: Brillio
- Location: Bangalore, Karnataka, India
- Workplace: Hybrid
- Experience: 5+ years
- Posted: 2025-07-17
- Apply: https://jobs.lever.co/brillio-2/cfae6eed-c2dd-43db-a89c-2957cb56e5c9/apply
- Source: https://jobmagic.ai/jobs/lead-data-engineer-r01553055-brillio-xd754h

## Requirements

- About the Role
- We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and BigQuery to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.
- Key Responsibilities
- 1. Data Migration & Cloud Modernization
- Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).
- Lead the migration of large-scale datasets to Google BigQuery.
- Design and implement data migration strategies ensuring data quality, integrity, and performance.
- 2. Data Integration & Streaming
- Integrate data from various structured and unstructured sources, including APIs, relational databases, and IoT devices.
- Build real-time streaming pipelines for large-scale ingestion and processing of IoT and telemetry data.
- 3. ETL / Data Pipeline Development
- Modernize and refactor legacy SSIS packages into cloud-native ETL pipelines.
- Develop scalable, reliable workflows using Apache Airflow, Python, Spark, and GCP-native tools.
- Ensure high-performance data transformation and loading into BigQuery for analytical use cases.
- 4. Programming & Query Optimization

## Description

**Lead Data Engineer**

### Primary Skills

- GCP, Big Query, Python, Airflow, SQL, DBT

### Job requirements

- **About the Role**

- We are seeking a **Senior Data Engineer** with deep expertise in **Google Cloud Platform (GCP)** and **BigQuery** to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.

-

- **Key Responsibilities**

- 1. **Data Migration & Cloud Modernization**

- Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).

- Lead the migration of large-scale datasets to **Google BigQuery**.

- Design and implement data migration strategies ensuring data **quality**, **integrity**, and **performance**.

- 2. **Data Integration & Streaming**

- Integrate data from various structured and unstructured sources, including **APIs**, **relational databases**, and **IoT devices**.

- Build **real-time streaming pipelines** for large-scale ingestion and processing of IoT and telemetry data.

- 3. **ETL / Data Pipeline Development**

- Modernize and refactor legacy **SSIS packages** into **cloud-native ETL pipelines**.

- Develop scalable, reliable workflows using **Apache Airflow**, **Python**, **Spark**, and **GCP-native tools**.

- Ensure high-performance data transformation and loading into **BigQuery** for analytical use cases.

- 4. **Programming & Query Optimization**

- Write and optimize complex **SQL queries**, stored procedures, and scheduled jobs within BigQuery.

- Develop **modular**, **reusable transformation scripts** using **Python**, **Java**, **Spark**, and SQL.

- Continuously monitor and optimize **query performance** and **cost efficiency** in the cloud data environment.

-

- **Required Skills & Experience**

- 5+ years in **Data Engineering** with a strong focus on cloud and big data technologies.

- Minimum **2+ years of hands-on experience with GCP**, specifically **BigQuery**.

- Proven experience migrating on-premise data systems to the **cloud**.

- Strong development experience with **Apache Airflow**, **Python**, and **Apache Spark**.

- Expertise in **streaming data ingestion**, particularly in **IoT or sensor data** environments.

- Strong **SQL** development skills; experience with **BigQuery performance tuning**.

- Solid understanding of **cloud architecture**, **data modeling**, and **data warehouse design**.

- Familiarity with **Git** and CI/CD practices for managing data pipelines.

-

- **Preferred Qualifications**

- **GCP Professional Data Engineer** certification.

- Experience with modern data stack tools like **dbt**, **Kafka**, or **Terraform**.

- Exposure to **ML pipelines**, **analytics engineering**, or **DataOps/DevOps** methodologies.

-

- **Why Join Us?**

- Work with cutting-edge technologies in a fast-paced, collaborative environment.

- Lead cloud transformation initiatives at scale.

- Competitive compensation and benefits.

- Remote flexibility and growth opportunities.