1000000567.Data Engineer Lead.Info Tech Services
Tasks
- Automate recovery version control and recurring workflows
- Build anomaly detection metadata validation and data lineage tracking
- Collaborate with data architects on schemas and domain models
- Conduct architectural reviews and select data engineering tools
- Coordinate integrations event publishing and system changes
- Coordinate project planning and workload balancing
- Coordinate with cybersecurity and IT operations on patching
- Define engineering goals OKRs and performance metrics
- Define engineering standards
- Design data pipelines
- Develop and deliver scalable data systems
- Drive automation for deployments and recurring tasks
- Ensure pipeline reliability performance and security
- Establish data governance access control and privacy compliance
- Guide containerization and infrastructure as code
- Implement CI/CD and observability pipelines
- Implement data quality validation and QA practices
- Implement platform observability metrics logging alerting
- Implement real time streaming and event based architectures
- Lead data engineering function
- Manage cost and resource optimization for cloud data services
- Manage onboarding and training for new team members
- Mentor and lead data engineering staff
- Monitor log and manage incidents for data operations
- Optimize batch processing and analytics query performance
- Orchestrate data workflows across cloud and on prem
- Oversee data pipeline APIs and workflows
- Perform root cause analysis for recurring data issues
- Promote test driven development and code review
- Support compliance audits and data control implementation
Perks/Benefits
- N/A
Skills/Tech-stack
AI Automation | AWS Glue | AWS Kinesis | Access Control | Alerting | Apache Airflow | Apache Flink | Apache Spark | Automated incident management | Azure Data | Azure Data Factory | CI/CD | Cause analysis | Cloud Architecture | Cloud Computing | Cloud Pub/Sub | Code review | Containerization | Data Factory | Data Governance | Data Lineage | Data Quality | Data Security | Data Streaming | Data Validation | Databricks | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Pub/Sub | Google Dataflow | Hadoop | Hybrid Cloud | IaC | Incident Management | Infrastructure as Code | Kafka | Logging | MLOps | Machine Learning | Monitoring | Observability | Privacy Compliance | Pub/Sub | Python | Real Time | Real-Time Data Streaming | Real-time Data | Root Cause Analysis | Root cause | SQL | Scala | Snowflake | Test-Driven | Test-Driven Development | Version control | Workflow Orchestration | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeExposure to real-world projects | Learning and development opportunities | MentorshipEntry-level InternshipBoston, MA, United States10h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States10h ago
-
Associate AI Solutions & Programs Lead USD 90K-115KArtificial Intelligence | Budget Monitoring | Business Process | Business process improvement | Change Management401k | Dental insurance | Employee discounts | Hybrid work schedule | Medical insuranceMid-level Full TimeNew York, NEW YORK, United States R10h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R10h ago
-
Lead Data Engineer USD 115K-125KAI Automation | Agile | Cloud Data | Cloud Data Platforms | Data Modeling401k | Commuter benefits | Dental insurance | Disability coverage | EAPSenior-level Full TimeColumbia, MD, United States12h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States12h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R13h ago
-
Senior Marketing Operations - US USD 145K-155KAI tools | Analytics | Attribution | Attribution Models | AutomationSenior-level Full TimeNew York City, NY, US14h ago
-
Global Field Quality Performance & Analytics Manager USD 117K-162KAutomotive Quality | Data Quality | Data Visualization | Data analytics | KPI governanceSenior-level Full TimeAuburn Hills, MI, United States15h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York15h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton15h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …15h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI Integration | AWS | Airflow | Apache Spark | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …15h ago
-
Operate Manager USD 147K-174KJira | MySQL | Python | R | TableauMentoring | Professional development | Remote work flexibilitySenior-level Full TimeJersey City, New Jersey, United States15h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …15h ago
-
Data Engineer | TS/SCI Required USD 93K-155KApplication Security | Cloud Engineering | Data Management | Data Security | Full StackMid-level Full TimeTampa, Florida, United States15h ago
-
Databricks Senior Consultant USD 113K-188KAWS | Azure | Business Intelligence | Cloud platform | Data EngineeringSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …15h ago
-
AI & Data Supply Chain Engineer USD 116K-229KCapacity modeling | Data Modeling | Demand Planning | Enterprise Resource Planning | Inventory PlanningTravel 50%Mid-level Full TimeSeattle, Washington, United States15h ago
-
QA Engineering Lead, AI Native USD 134K-165KAdversarial Testing | Analytics | Artificial Intelligence | Automation Framework | Automation coverageSenior-level Full TimeMenlo Park, CA16h ago
-
Software Engineering Manager II, Embedded Systems/Firmware, Platforms Infrastructure Engineering USD 207K-300KC# | C++ | Code review | Embedded operating systems | JavaSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache SparkSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Global Product Lead, Global Business Applied AI USD 178K-258KArtificial Intelligence | Business Intelligence | CRM | Customer satisfaction | Data AnalysisSenior-level Full TimeMountain View, CA, USA16h ago
-
Senior Data Engineers USD 123K-215KAWS | CI/CD | Data Guard | Data Modeling | Data QualityCareer development training | Company retirement match | Counseling support | Disability benefits | Free financial coachingSenior-level Full TimePhoenix, AZ, United States23h ago
-
AWS | Anomaly Detection | Apache Spark | Azure | BI IntegrationSenior-level Full TimeUnited States23h ago
-
Senior AI Data Engineer USD 155K-185KApache Airflow | Apache Spark | Azure Synapse | BigQuery | ClickHouseEmployer paid Medical Dental Vision Insurance | Flexible paid time off | Manager check ins | Paid cell phone and service | Paid parental leaveSenior-level Full TimeRemote - United States R1d ago