Top 23 Batch Open-Source Projects

• PEASS-ng

  90 14,899 8.3 C#

  PEASS - Privilege Escalation Awesome Scripts SUITE (with colors)

  

Project mention: Great enumeration scripts? | /r/oscp | 2023-06-02

Once on a system, something like Linpeas or Winpeas would be useful: https://github.com/carlospolop/PEASS-ng

• dataloader

  47 12,635 3.1 JavaScript

  DataLoader is a generic utility to be used as part of your application's data fetching layer to provide a consistent API over various backends and reduce requests to those backends via batching and caching.

  

Project mention: Delving into the Black Magic of GraphQL DataLoader! 🌌✨ | dev.to | 2024-01-16

When I began working with GraphQL, I had concerns about the N+1 query problem. In my research, I came across the DataLoader pattern and its implementation on GitHub. While I explored various examples of its usage, I still struggled to grasp how it operates internally. Join me in delving a bit deeper into GraphQL DataLoader! :)

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• beam

  30 7,519 10.0 Java

  Apache Beam is a unified programming model for Batch and Streaming data processing.

  

Project mention: Ask HN: Does (or why does) anyone use MapReduce anymore? | news.ycombinator.com | 2024-01-24

The "streaming systems" book answers your question and more: https://www.oreilly.com/library/view/streaming-systems/97814.... It gives you a history of how batch processing started with MapReduce, and how attempts at scaling by moving towards streaming systems gave us all the subsequent frameworks (Spark, Beam, etc.).

As for the framework called MapReduce, it isn't used much, but its descendant https://beam.apache.org very much is. Nowadays people often use "map reduce" as a shorthand for whatever batch processing system they're building on top of.

• seatunnel

  31 7,388 9.8 Java

  SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

  

Project mention: SeaTunnel – super high-performance, distributed data integration tool | news.ycombinator.com | 2024-04-28

• EFCore.BulkExtensions

  16 3,488 9.0 C#

  Entity Framework EF Core efcore Bulk Batch Extensions with BulkCopy in .Net for Insert Update Delete Read (CRUD), Truncate and SaveChanges operations on SQL Server, PostgreSQL, MySQL, SQLite

Project mention: Best way to do mass inserts with Entity Framework | /r/dotnet | 2023-06-08

EF Core Bulk Extensions has helped me out many a day.

• Scio

  7 2,523 9.6 Scala

  A Scala API for Apache Beam and Google Cloud Dataflow.

  

• anime-downloader

  3 1,918 0.0 Python

  A simple but powerful anime downloader and streamer.

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• gitbatch

  0 1,528 0.0 Go

  manage your git repositories in one place

• media-autobuild_suite

  17 1,456 8.9 Shell

  This Windows Batchscript helps setup a Mingw-w64 compiler environment for building ffmpeg and other media tools under Windows.

  

Project mention: nppicc64_12.dll, nppidei_12.dll, nppif64_12.dll, nppig64_12.dll was not fount . | /r/ffmpeg | 2023-07-11

logs.zip

• graphql-batch

  3 1,404 6.2 Ruby

  A query batching executor for the graphql gem

  

• Defeat-Defender-V1.2.0

  10 1,364 3.0 Batchfile

  Powerful batch script to dismantle complete windows defender protection and even bypass tamper protection ..Disable Windows-Defender Permanently....Hack windows. POC

Project mention: Disabling defender with administrator, reverse shell | /r/hacking | 2023-05-13

Can you work around by creating a folder exception and then killing all the Defender services? https://github.com/swagkarna/Defeat-Defender-V1.2.0/blob/main/Defeat-Defender.bat

• facebook

  0 1,273 4.0 Go

  A Facebook Graph API SDK For Go.

• udocker

  2 1,221 9.1 Python

  A basic user tool to execute simple docker containers in batch or interactive systems without root privileges.

  

• ffmpeg_batch

  3 771 9.4 C#

  FFmpeg Batch AV Converter

• mnamer

  12 723 5.8 Python

  media file renaming and organizing tool

• easy-batch

  0 600 0.0 Java

  The simple, stupid batch framework for Java

  

• handbrake-js

  1 548 3.3 JavaScript

  Video encoding / transcoding / converting for node.js

• java-dataloader

  1 486 6.6 Java

  A Java 8 port of Facebook DataLoader

  

Project mention: GraphQL Java Data Loader | dev.to | 2023-12-21

https://www.graphql-java.com/documentation/batching/ https://github.com/graphql-java/java-dataloader

• CuteVirusCollection

  2 467 0.0 HTML

  A Collection of Cute But Deadly Viruses

• ADB-and-FastbootPlusPlus

  7 426 5.5 Batchfile

  A small Application for Windows that allows you to install the latest Version of ADB and Fastboot Files on the Computer without installing the entire Android SDK Package + Toolkit & Commands

• mpv-install

  7 417 0.0 Batchfile

  Sets up file associations for mpv on Windows

• CWH (CloudWatch Handler)

  0 413 0.0 PHP

  Amazon Web Services CloudWatch Logs Handler for Monolog library

• sidekiq-batch

  1 348 6.4 Ruby

  Sidekiq Batch Jobs Implementation

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Batch related posts

• Ask HN: Does (or why does) anyone use MapReduce anymore?

  2 projects | news.ycombinator.com | 24 Jan 2024

• Delving into the Black Magic of GraphQL DataLoader! 🌌✨

  2 projects | dev.to | 16 Jan 2024

• How do Streaming Aggregation Pipelines work?

  1 project | /r/dataengineering | 6 Dec 2023

• Ansys WB in batch mode

  1 project | /r/ANSYS | 30 Nov 2023

• [GUIDE-WIP-NEED-TESTERS-WINDOWS 11 BUG] 1200Mbps speed displayed / 500Mbps file transfer / 200Mbps confirmed using windows 11 hotspot with Quest 3 with <15ms network latency and no stuttering

  1 project | /r/OculusQuest | 15 Oct 2023

• Releasing Temporian, a Python library for processing temporal data, built together with Google

  2 projects | /r/Python | 17 Sep 2023

• nppicc64_12.dll, nppidei_12.dll, nppif64_12.dll, nppig64_12.dll was not fount .

  1 project | /r/ffmpeg | 11 Jul 2023
• A note from our sponsor - SaaSHub
  www.saashub.com | 4 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com