Sr Data Tech Lead - Trading and Supply Freight Data Platform
Tasks
- Build data pipelines
- Coordinate stakeholders and executive communication
- Define data product roadmaps
- Deliver data platform solutions
- Ensure data governance and lineage
- Implement data modeling and metadata management
- Implement security and privacy controls
- Lead data architecture and engineering delivery
- Manage CI/CD deployments
- Optimize data pipeline performance
- Perform root cause analysis
- Troubleshoot pipeline issues and enforce SLAs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Functions | Azure Logic | Azure Logic Apps | CI/CD | Concurrency | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Databricks | Databricks Delta | Databricks Delta Live Tables | Deadlock management | Delta Live Tables | Docker | Docker Kubernetes | FastAPI | GitHub Actions | Kubernetes | Lineage | Logic Apps | Metadata Management | MySQL | PostgreSQL | Python | REST API | SLA management | SQL | SQL Server | Scala | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Enterprise Analytics Lead USD 119K-222KAccess Control | Analysis Services | Analytics Cloud | Azure Synapse | Azure Synapse AnalyticsExtra day off every other week | Flexible 980 schedule | In-office work scheduleSenior-level Full TimePortsmouth, NH, United States10h ago
-
Lead Data Engineer USD 170K-185KAWS Athena | AWS Data | AWS Data Pipeline | AWS EMR | AWS Glue401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeMcLean, VA, United States14h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …15h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL15h ago
-
Apache Airflow | Apache Flink | Apache Hive | Apache Kafka | Apache SparkFast-paced work environment | Hands-on project experience | MentorshipEntry-level InternshipSan Jose, California, United States15h ago
-
Data Engineering Leader, Analytics USD 174K-250KBias Mitigation | Business Intelligence | Data Architecture | Data Modeling | Data PipelinesSenior-level Full TimeMenlo Park, CA | New York, …16h ago
-
Cloud Architecture | Cost Optimization | Data Pipelines | Distributed Training | Fine TuningSenior-level Full TimeReston, VA, USA; Boulder, CO, USA16h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL16h ago
-
Engineering Team Lead- Data & AI Platform USD 175K-200KAWS | Amazon EMR | Amazon S3 | Apache Airflow | Apache IcebergSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL20h ago
-
AI Solutions Architect USD 140K-203KAI machine learning | API Design | Access Management | Application Architecture | Architecture DecisionCareer Development Programs | Part-time telework | Relocation assistance | Robust benefitsSenior-level Full TimeReston, VA, US22h ago
-
AWS Glue | AWS Lambda | AWS S3 | Agile | AirflowSenior-level Full TimeTX, Austin, 11501 Alterra Pkwy STE …1d ago
-
Cybersecurity Data Architect USD 132K-195KAccess Control | Cloud Security | Data Architecture | Data Governance | Data LineageMust live in Texas | Remote workSenior-level Full TimeRemote - TX, United States R1d ago
-
Lead Data Platform Engineer, Snowflake USD 165K-216KAWS | Access Control | Audit Logging | Cost Optimization | Data masking401k Savings Plan Company Match | Health care and wellness plans | Paid Holidays | Paid time off | Referral servicesSenior-level Full TimePlano, United States1d ago
-
Applied AI Specialist USD 171K-200KAPI Integration | Anomaly Detection | Cloud Native | Cloud Native Architecture | Computer VisionContinued Career Development | Employee resource groups | Flexible WFH policy | Generous PTO policy | Mental and physical wellness programsSenior-level Full TimeUS-Washington-Remote, United States R1d ago
-
Lead Sales Analytics & Reporting Analyst USD 145K-165KAWS | Business Intelligence | CRM Analytics | ChatGPT enterprise | Dashboard Development401k plan | Health benefits | Paid time off | Parental leave | Stock optionsSenior-level Full TimeCampbell, CA1d ago
-
Block Storage | DBaaS | Data Architecture | Data Backup | Data Governance401k retirement plan | Disability insurance | Life insurance | Medical, dental & vision coverage | Paid HolidaysSenior-level Full TimeLocation(s): Irving, Texas, United States1d ago
-
AWS | Canonical Data | Canonical Data Model | Data Architecture | Data GovernanceCompany sponsored medical insurance | Company-sponsored dental insurance | Company-sponsored vision insurance | Discretionary annual bonus | Discretionary stock based long term incentivesMid-level Full TimeUS - NC - Raleigh, United …1d ago
-
Lead Decision Science Analyst - P&C Claims GenAI USD 143K-273KA/B | A/B Testing | B testing | Bias detection | Causal Inference401k | Adoption Assistance | Career path planning | Continuing education | Hybrid flexibilitySenior-level Full TimeSan Antonio, Texas, UNITED STATES; Chesapeake, …1d ago
-
Lead Business Strategy Analyst - P&C Claims GenAI USD 127K-243KAI Solution | AI solution design | Adobe Analytics | Artificial Intelligence | Compliance401k | Adoption Assistance | Career path planning | Continuing education | Life insuranceSenior-level Full TimeSan Antonio, Texas, UNITED STATES; Chesapeake, …1d ago
-
AI & Data Solution Architect USD 96K-192KAWS Glue | AWS Lambda | Access Control | Amazon EMR | Amazon RedshiftBereavement leave | Dependent care spending account | Health care spending account | Health savings account | Life insuranceSenior-level Full TimeCAG24: Atlanta Digital Hub, 3350 Riverwood …1d ago
-
Lead Data Engineer USD 75KAirflow | Apache Beam | Autoscaling | BigQuery | CI/CD401-k plan | Commuter benefits | Discounts and savings | Paid time off | Parental leaveSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Streaming Data Architect USD 140K-155KAWS | Azure | Cloud Native | Cloud-native Architectures | Data GovernanceDental insurance | Generous PTO | Health insurance | Remote work | Retirement savings planSenior-level Full TimeAberdeen Proving Ground, MD, US1d ago
-
API Integration | Cloud Computing | Dashboards | Data Architecture | Data GovernanceMid-level Full TimeFalls Church, VA; Falls Church, VA1d ago
-
Senior Manager, Data Engineering USD 180K-225KAWS Bedrock | AWS Glue | AWS Lambda | AWS S3 | AWS Step Functions401k matching | Health benefits | Roth IRA options | Unlimited PTOSenior-level Full TimeHybrid - New York, NY R1d ago