Dataforest is looking for a Middle Data Engineer to join our team and work on the Dropship project — a cutting-edge data intelligence platform for e-commerce analytics. You will be responsible for developing and maintaining a scalable data architecture that powers large-scale data collection, analysis, and integrations. We are waiting for your CV!
Requirements: * 2+ years of commercial experience with Python. * Solid foundational knowledge of ElasticSearch, including: * Ability to perform batch updates using bulk operations. * Understanding index mapping and how to adapt it for your project’s needs. * (Nice to Have) Some exposure to vector search concepts. * Experience working with PostgreSQL databases. * Experience with monitoring tools, ideally CloudWatch, Prometheus, or Grafana. * Familiarity with data structures and algorithms, able to choose suitable solutions for common data processing tasks. * Excellent programming skills in Python with a strong emphasis on optimization and code structuring. * Understanding of ETL principles. * Strong teamwork and communication abilities, ready to learn from and assist team members. * Experience working with Linux environments, cloud services (AWS), and Docker. * Ability to manage your tasks and work proactively under supervision.
Nice to Have: * Experience in web scraping, data extraction, cleaning, and visualization. * Understanding of multiprocessing/multithreading in Python. * Familiarity with Redis. * Experience with Flask / Flask-RESTful for API development. * Knowledge and experience with Kafka.
Key Responsibilities: * Develop and maintain a robust data processing architecture using Python. * Effectively utilize ElasticSearch and PostgreSQL for efficient data management. * Design and manage data pipelines using Kafka and SQS. * Optimize code for better performance and maintainability. * Design and implement efficient ETL processes. * Work with AWS technologies to ensure flexible and reliable data processing systems. * Collaborate with colleagues, actively participate in code reviews, and improve technical knowledge. * Take responsibility for your tasks and suggest improvements to processes and systems.
We offer: * Working in a fast-growing company; * Great networking opportunities with international clients, challenging tasks; * Personal and professional development opportunities; * Competitive salary fixed in USD; * Paid vacation and sick leaves; * Flexible work schedule; * Friendly working environment with minimal hierarchy; * Team building activities, corporate events.
