Sr Data Tech Lead - Trading and Supply Freight Data Platform
Tasks
- Build data pipelines
- Coordinate stakeholders and executive communication
- Define data product roadmaps
- Deliver data platform solutions
- Ensure data governance and lineage
- Implement data modeling and metadata management
- Implement security and privacy controls
- Lead data architecture and engineering delivery
- Manage CI/CD deployments
- Optimize data pipeline performance
- Perform root cause analysis
- Troubleshoot pipeline issues and enforce SLAs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Functions | Azure Logic | Azure Logic Apps | CI/CD | Concurrency | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Databricks | Databricks Delta | Databricks Delta Live Tables | Deadlock management | Delta Live Tables | Docker | Docker Kubernetes | FastAPI | GitHub Actions | Kubernetes | Lineage | Logic Apps | Metadata Management | MySQL | PostgreSQL | Python | REST API | SLA management | SQL | SQL Server | Scala | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Marketing Analytics Lead USD 164K-225KData Analysis | Data Science | Excel | Experimentation | Key Performance IndicatorsCompetitive pay | Comprehensive benefits | Equity | Hybrid work | Remote flexibility up to 4 weeks per yearSenior-level Full TimeNew York City, NY; San Francisco, … R9h ago
-
AWS | Apache Iceberg | Application refactoring | Architectural Reviews | Cloud ComputingFlexible work culture | Mentorship | Work-life balanceSenior-level Full TimeNew York, New York, USA10h ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R10h ago
-
Data Engineering Lead Senior Manager USD 148K-306KAWS | Agile | Data Architecture | Data Modeling | Data QualityIndustry training | Professional certificationsSenior-level Full TimeWashington, DC11h ago
-
AWS | Access Control | Amazon Kinesis | Amazon Neptune | Apache Kafka401k match | Dental insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeMountain View, California, United States12h ago
-
Senior-level Full TimeDeerfield, IL, United States R13h ago
-
Analytics Lead, Japan Partnerships USD 132K-165KDashboard Development | Data Visualization | Databricks | Forecasting | KPI DevelopmentAI experimentation tools | Course access | Learning budget | Monthly personal development daySenior-level Full TimeSan Francisco, CA13h ago
-
Analytics Lead, Japan Partnerships USD 132K-165KAutomation | Dashboard Development | Data Visualization | Databricks | ForecastingCourse access | Equity | Learning budgetSenior-level Full TimeSan Francisco, CA13h ago
-
Data Platform Architect USD 131K-165KAI integration | Artificial Intelligence | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimeSuitland, MD14h ago
-
Embedded Software Engineer– Technical Lead USD 150K-175KARM | Agile | Build systems | C++ | CI/CD401k match | Health insurance | Paid time off | Relocation not availableSenior-level Full TimeWaltham, MA, United States15h ago
-
Product Lead, People Analytics USD 101K-133KCalculated Fields | Dashboard Development | Data Governance | Data Modeling | Data Pipelines401k | Annual performance bonuses | Life and disability insurance | Medical, dental, and vision insurance | Paid HolidaysSenior-level Full TimeNew York, New York, United States15h ago
-
Data Engineer I USD 87K-137KAPIs | Clay | Data Governance | Data Modeling | Data Quality401k match | Conference attendance support | Employee resource groups | Flexible PTO | Flexible work scheduleMid-level Full TimeMorrisville, United States17h ago
-
Manager, Data Engineering USD 170K-205KAWS | Agile | Airflow | DBT | Data PipelinesBackground check | Caregiver leave | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeWashington DC19h ago
-
API Design | Apache Airflow | Automated testing | CI/CD | DBTComprehensive health care and benefits | Growth opportunities | Inclusion and diversity | Public service missionSenior-level Full TimePhiladelphia, PA, United States19h ago
-
Solutions Architect - Financial Services (Hunter) USD 180K-247KAWS | Apache Spark | Azure | Cloud platform | DSSTravel opportunitiesSenior-level Full TimeGeorgia; Illinois; Massachusetts; New Jersey; New …20h ago
-
AI Solutions Architect USD 148K-226KApache Kafka | Apache Spark | Application Programming | Application Programming Interfaces | Batch ProcessingSenior-level Full TimeTyson's Corner, VA1d ago
-
AWS | Automated testing | Automation | Azure | Backend DevelopmentEmployee stock purchase plan | Health insurance | Life insurance | Paid time off | Retirement or Pension PlanSenior-level Full TimeSan Jose, CA, USA Office (SANJOSE)1d ago
-
Senior-level Full TimeSan Jose, CA, United States1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiBenefits package | Full-time W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Control | Alation | Amazon Redshift | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Hudi | AtlanCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Clinical Data Science Lead USD 110K-138KAcceptance Testing | Change Control | Clinical Trial Design | Clinical data | Clinical data managementDisability coverage | Employee Assistance programmes | Health and Wellbeing Programmes | Learning and development opportunities | Life assuranceSenior-level Full TimeUS, Blue Bell (ICON), United States1d ago
-
Prompt Engineering USD 100K-150KAgentic Workflows | Chunking | Cost Optimization | Embeddings | Evaluation FrameworksBenefits | Full-time W2 employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
C2 Mission Systems Data Architect USD 99K-225KAWS | Amazon Kinesis | Apache Flink | CI/CD | Cloud ArchitectureDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, NV, Nellis AFB (4370 Washington …1d ago