Senior Software Engineer (Python)
Tasks
- Automate workflows with Apache Airflow
- Build data ingestion pipelines
- Build distributed crawling bots
- Build search capabilities with ElasticSearch OpenSearch
- Clean and normalize raw data
- Deploy solutions in Kubernetes on AWS
- Develop APIs for structured classified data
- Extract data from web pages APIs and PDFs
- Integrate classification models into the pipeline
- Optimize and scale processing with Spark
- Preprocess data for classification and search indexing
- Unify documents into a coherent schema
Perks/Benefits
- 401k match
- Accidental death and dismemberment insurance
- Continuing education support
- Dental insurance
- Fitness reimbursement
- Flexible spending accounts
- Health insurance
- Health savings accounts
- Home office setup bonus
- Hybrid work
- Life insurance
- Medical leave
- Mental health counseling
- Paid Maternity Leave
- Paid time off
- Parental bonding leave
- Prescription Coverage
- Remote work
- Vision insurance
- Wellness benefits
Skills/Tech-stack
AWS | Anti-scraping | Apache Airflow | Data Normalization | Data cleaning | Distributed crawling | Document Classification | EMR | Elasticsearch | Hugging Face | Kubernetes | LLMs | Language Processing | Machine Learning | NLP models | Natural Language | Natural Language Processing | NoSQL | OCR | OpenSearch | PDF Processing | PyMuPDF | PyTorch | Python | REST APIs | SQL | Scrapy | Search Indexing | Spacy | Spark | TensorFlow | Tesseract
Education
N/A
Related jobs
-
Senior MLOps Engineer BRL 156K-180KAPIs | AWS | CI/CD | Data Catalog | Data GovernanceCareer growth opportunities | Emotional wellbeing program | Flexible schedule | Healthcare dental and life insurance | Home office reimbursementSenior-level Full TimeBrazil (Remote) R12h ago
-
Data Engineer - Azure & Microsoft Fabric CAD 85K-166KARM Templates | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsFlexible location within Eastern or Central time zones | Hybrid workMid-level Full TimeRemote R14h ago
-
Data & AI Platform Engineer USD 95K-155KAI Search | APIs | AWS | Airflow | ArcGIS401k matching | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote, United States R15h ago
-
Sr Data Engineer USD 100K-120KAPIs | AWS | AWS Glue | Airflow | Amazon RedshiftFully remote | Mentorship | On-call supportSenior-level Full TimeOrlando, FL, United States R15h ago
-
Embedded Software Verification & UI Programmer USD 90K-120KC# | DO-178B | DO-178C | LDRA | MCDC401k match | Certification assistance | Flexible workplace | Health dental life disability insurance | Professional development supportSenior-level Full TimeRemote R16h ago
-
APIs | DevOps | Distributed Systems | Docker | Enterprise IntegrationsOccasional evening collaboration | Remote work | Strong growth potentialSenior-level Full TimeRemote job R16h ago
-
Staff Machine Learning Systems Engineer (MLOps) USD 210K-250KAWS EKS | Alerting | Autoscaling | CI/CD | ClickHouseFlexible remote work | Healthcare industry domain experienceSenior-level Full TimeUS Remote R17h ago
-
Analytics Engineer EUR 122K-122KAirflow | Canonical Data | DBT | Data Contracts | Data ModelingQuarterly in person surges | Remote-firstMid-level Full TimeHybrid - Luxembourg R20h ago
-
CAG | DBT | Data Modeling | Elasticsearch | GrafanaEmployee discounts | Employee events | Flexible working hours | Free drinks | Health offersSenior-level Full TimeHinterm Hauptbahnhof 3-5, 76137 Karlsruhe R20h ago
-
DBT | Elasticsearch | Grafana | Looker | PostgreSQLEmployee discounts | Employee events | Flexible working hours | Health offers | Hybrid workSenior-level Full TimeRevaler Straße 28-31, 10245 Berlin R20h ago
-
API | AWS S3 | Apache Airflow | Apache NiFi | Azure DataDental insurance | Gym membership | Health insurance | Life insurance | Meal voucherEntry-level Full TimeRemoto, Brasil R21h ago
-
Data Engineer (Azure Databricks) EUR 42K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Data FactoryCertification programs | Health insurance | Internal mobility | Mentorship | Professional development opportunitiesMid-level Full TimeBarcelona, CT, Spain R1d ago
-
Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Data FactoryHealth insurance | Internal mobility | Internship opportunities | Mentorship | Professional development programsMid-level Full TimeŁódź, Łódź Voivodeship, Poland R1d ago
-
Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeWrocław, Lower Silesian Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeMálaga, AN, Spain R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Mentorship | Professional development | Relocation programMid-level Full TimePoznań, Greater Poland Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Mentorship | Professional development opportunities | Relocation program | Remote work flexibilityMid-level Full TimeWrocław, Lower Silesian Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional development programsMid-level Full TimeGdańsk, Pomeranian Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Mentorship programs | Professional development | Relocation program | Remote work flexibilityMid-level Full TimeZaragoza, AR, Spain R1d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeSeville, AN, Spain R1d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Global projects | Health insurance | Internal mobility | MentorshipMid-level Full TimeBarcelona, CT, Spain R1d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsGlobal team events | Health insurance | Internal mobility | Mentorship | Mentorship programsMid-level Full TimeValència, VC, Spain R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Global projects | Health insurance | Mentorship | Professional development opportunitiesMid-level Full TimeKraków, Lesser Poland Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Internship opportunities | Mentorship | Professional developmentMid-level Full TimeWarsaw, Masovian Voivodeship, Poland R1d ago
-
GCP Data Engineer/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQueryFlexible working | Opportunities for growth | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R1d ago