Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN 55445, United States
USD 132K-238K Senior-level Full Time
Tasks
- Architect and build scalable data pipelines
- Collaborate with product and business stakeholders
- Develop low latency high throughput data APIs and services
- Develop real-time and batch data processing solutions
- Drive data governance, security, and compliance
- Lead data services and platform lifecycle management
- Optimize data models and workflows
- Promote big data and cloud best practices
- Provide technical leadership and mentor engineers
Perks/Benefits
- 401k
- Employee discount
- Health benefits
- Paid Long Term Disability
- Paid Short Term Disability
- Paid national holidays
- Paid sick leave
- Paid vacation
Skills/Tech-stack
AWS | Azure | BigQuery | Cloud Computing | Data Compliance | Data Governance | Data Modeling | Data Security | Databricks | Distributed Systems | EMR | ETL | Flink | GCP | GRPC | GraphQL | Hadoop | Java | Kafka | Kinesis | PySpark | REST | S3 | Scala | Snowflake | Spark
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States8h ago
-
Lead Data Engineer USD 114K-160KBusiness Objects | Business Process | Business Process Redesign | Case Development | Compliance AuditingSenior-level Full TimeColumbus, GA, United States9h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA10h ago
-
AWS | Cloud Computing | Columnar Storage | Dataframe optimization | JavaEquity | Full benefits | Hybrid work in office component required | Performance-focused culture | Startup environmentSenior-level Full TimeLos Angeles, CA, United States10h ago
-
Senior-level Full TimeJersey City, NJ, United States12h ago
-
Applied AI/ML [Multiple Positions Available] USD 165K-195KAI Governance | AI governance framework | AWS | Azure | BM25Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States13h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton13h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton13h ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R13h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA14h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA14h ago
-
Algorithms | Backend software | C++ | Control Plane | Data StructuresSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Algorithms | C++ | Cloud Storage | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …14h ago
-
Senior Staff Engineer, GDC AI Inference Platform USD 262K-365KAgent coordination | C++ | Cloud infrastructure | Containerization | Data StructuresBonus | Equity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA14h ago
-
Business Intelligence - Data Engineer 133-2015 USD 80K-115KData Transformation | Data analytics | Data pipeline | Dependency management | ETLMid-level Full TimeTulsa, OK, US17h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935518h ago
-
PIIM Analytics Lead USD 105K-160KBI Report Server | BigQuery | DAX | Data Visualization | ETLFull Time Office Project Telework | Relocation assistance | Robust benefits | Training and developmentSenior-level Full TimeHouston, TX, US21h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US21h ago
-
PIIM Analytics Lead USD 105K-160KBI Report Server | BigQuery | DAX | Data Governance | ETLDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeClay, NY, US21h ago
-
PIIM Analytics Lead USD 105K-160KBI Report Server | BigQuery | DAX | ETL | MatplotlibPaid time off | Relocation assistance | Training and developmentSenior-level Full TimeChandler, AZ, US21h ago
-
PIIM Analytics Engineer USD 105K-160KAI/ML | APIs | Access Control | Azure Databricks | Code AutomationFull time office or project telework | Relocation assistanceMid-level Full TimeHouston, TX, US21h ago