Sr Data Tech Lead - Trading and Supply Freight Data Platform
Tasks
- Build data pipelines
- Coordinate stakeholders and executive communication
- Define data product roadmaps
- Deliver data platform solutions
- Ensure data governance and lineage
- Implement data modeling and metadata management
- Implement security and privacy controls
- Lead data architecture and engineering delivery
- Manage CI/CD deployments
- Optimize data pipeline performance
- Perform root cause analysis
- Troubleshoot pipeline issues and enforce SLAs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Functions | Azure Logic | Azure Logic Apps | CI/CD | Concurrency | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Databricks | Databricks Delta | Databricks Delta Live Tables | Deadlock management | Delta Live Tables | Docker | Docker Kubernetes | FastAPI | GitHub Actions | Kubernetes | Lineage | Logic Apps | Metadata Management | MySQL | PostgreSQL | Python | REST API | SLA management | SQL | SQL Server | Scala | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Marketing Analytics Lead USD 164K-225KData Analysis | Data Science | Excel | Experimentation | Key Performance IndicatorsCompetitive pay | Comprehensive benefits | Equity | Hybrid work | Remote flexibility up to 4 weeks per yearSenior-level Full TimeNew York City, NY; San Francisco, … R8h ago
-
AWS | Apache Iceberg | Application refactoring | Architectural Reviews | Cloud ComputingFlexible work culture | Mentorship | Work-life balanceSenior-level Full TimeNew York, New York, USA9h ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R9h ago
-
Senior-level Full TimeDeerfield, IL, United States R12h ago
-
Embedded Software Engineer– Technical Lead USD 150K-175KARM | Agile | Build systems | C++ | CI/CD401k match | Health insurance | Paid time off | Relocation not availableSenior-level Full TimeWaltham, MA, United States14h ago
-
Data Engineer I USD 87K-137KAPIs | Clay | Data Governance | Data Modeling | Data Quality401k match | Conference attendance support | Employee resource groups | Flexible PTO | Flexible work scheduleMid-level Full TimeMorrisville, United States16h ago
-
API Design | Apache Airflow | Automated testing | CI/CD | DBTComprehensive health care and benefits | Growth opportunities | Inclusion and diversity | Public service missionSenior-level Full TimePhiladelphia, PA, United States19h ago
-
AWS | Automated testing | Automation | Azure | Backend DevelopmentEmployee stock purchase plan | Health insurance | Life insurance | Paid time off | Retirement or Pension PlanSenior-level Full TimeSan Jose, CA, USA Office (SANJOSE)1d ago
-
Senior-level Full TimeSan Jose, CA, United States1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiBenefits package | Full-time W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Control | Alation | Amazon Redshift | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Hudi | AtlanCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Clinical Data Science Lead USD 110K-138KAcceptance Testing | Change Control | Clinical Trial Design | Clinical data | Clinical data managementDisability coverage | Employee Assistance programmes | Health and Wellbeing Programmes | Learning and development opportunities | Life assuranceSenior-level Full TimeUS, Blue Bell (ICON), United States1d ago
-
Prompt Engineering USD 100K-150KAgentic Workflows | Chunking | Cost Optimization | Embeddings | Evaluation FrameworksBenefits | Full-time W2 employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
C2 Mission Systems Data Architect USD 99K-225KAWS | Amazon Kinesis | Apache Flink | CI/CD | Cloud ArchitectureDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, NV, Nellis AFB (4370 Washington …1d ago
-
Senior AI/ML Architect USD 131K-219KAPI Development | AWS | Azure | CI/CD | Data Governance12 paid holidays | Company-matching 401k | Disability benefits | Employee assistance program | Life insuranceSenior-level Full TimeGreenville, United States1d ago
-
Technical AI Lead, CRM and Salesforce Architecture USD 128K-185KAPI Integration | Agentic Workflows | Automation | CRM | Customer Data401k match | Dental insurance | Healthcare | Paid Holidays | Paid time offSenior-level Full TimeDenver Office, United States1d ago
-
Product Analytics Lead USD 26K-36KDashboards | Data Integrity | Data Modeling | Data Visualization | EconometricsSenior-level Full TimeSSC Irving TX, United States1d ago
-
Data Analyst, Specialist USD 100K-151KAWS | Azure | Big Data | Data Lakes | Data VisualizationHybrid work modelSenior-level Full TimeMalvern, PA, United States1d ago
-
Principal, Digital Data Architecture - Remote USD 112K-193KAPIs | Adobe Analytics | Adobe Customer Journey | Adobe Customer Journey Analytics | Adobe Experience401k contribution | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programs | Remote work flexibilitySenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Manager of Data Engineering USD 52K-52KAWS Glue | Apache Airflow | Apache Kafka | Buildkite | CI/CD401k matching | Company holidays | Medical coverage | Paid time off | Paid volunteer daysSenior-level Full TimeOH Columbus 7400 Safelite Way, United …1d ago
-
Architect of Data Architecture USD 114K-165KAPI Design | API Versioning | AWS | Access Control | Analytics engineering401k with company match | Family and medical leave | Medical, dental, vision and life insurance | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeKS Remote, United States R1d ago
-
Alteryx | Anomaly Detection | Artificial Intelligence | Data Governance | Data MiningSenior-level Full Time141753-NC-Three Wells Fargo Center, Charlotte, United … R1d ago
-
Data Modeling | Data Quality | Data Warehousing | Disaster Recovery | EPIC ClaritySenior-level Full TimeWyoming, United States; Wyoming, MI, United …1d ago