Data Engineer

Remote: yes Posted: 2025-01-15

ABOUT TRUELOGIC

At Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we’ve been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.

Our team of 600+ highly skilled tech professionals, based in Latin America, drives digital disruption by partnering with U.S. companies on their most impactful projects. Whether collaborating with Fortune 500 giants or scaling startups, we deliver results that make a difference.

By applying for this position, you’re taking the first step in joining a dynamic team that values your expertise and aspirations. We aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future.

- 5+ years working on the role professionally.

- Coding:

- Coding Python and use in data processing solutions and related data technologies like Pandas, and PySpark.

- Consume data from different sources like REST APIs.

- Data Stores:

- Work with relational and non-relational data stores (like: HBASE, Cassandra or MongoDB; S3, blobs).

- Consumption;

- Design.

- Data Streams (Kafka, Kinesis, Flume,) and message queuing (SQS, SNS, RabbitMQ, etc).

- Ensure that the data model scales and enables high performance.

- Distributed data stores.

- Processing:

- Data/Stream processing (Spark, Flink, Hadoop).

- Data pipelines, data ingestion pipelines, scalable streaming data pipelines processing.

- ETL using solutions:

- Talend;

- Informatica;

- SQL Server Integration Services (SSIS).