|1 day ago||3 days ago|
|MIT License||GNU General Public License v3.0 or later|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Automating Azure APIM configuration based on Logic App (standard) workflows' callback URLs
1 project | dev.to | 20 Apr 2022
My requirements need me to populate APIM's set-backend-service and rewrite-uri. With the above json, a user-defined function is required. And alas, as of now it's not possible in bicep :(
Farmer VS Pulumi
2 projects | reddit.com/r/AZURE | 4 Apr 2022
Bicep unfortunately chose to create a DSL instead of just exposing the dotnet API to allow IaC. Now there is a nuget package for Bicep core (https://github.com/Azure/bicep/pull/5826) you may be able to use dotnet code.
Getting Started with Azure Bicep
1 project | dev.to | 30 Mar 2022
Yes, as of version 0.3 Azure Bicep is production ready. It is supported by Microsoft Support Plans and Bicep has 100% parity with what can be accomplished by ARM template.
Bachelor-thesis about IaC and Bicep
1 project | reddit.com/r/AZURE | 23 Mar 2022
I suggest reading the bicep documentation as I don't think it will require 12,000 words to determine the answers to your questions.
Would I replace Terraform with Bicep ? 💪🏽
4 projects | dev.to | 10 Mar 2022
Bicep is open source with a strong community supporting it. All the binaries for the different supported operating systems can be downloaded from the official releases page of the Bicep open source project.
Azure Bicep - Reference Module Output in Same Module Call
1 project | reddit.com/r/AZURE | 8 Mar 2022
It sounds like you're running into this: https://github.com/Azure/bicep/issues/1631
[HIRING] Senior Software Engineer - Microsoft
2 projects | reddit.com/r/atljobs | 3 Feb 2022
The backend code is C#, with CosmosDb/TableStorage for persistence. Our client tools are also mostly C#, with some TypeScript, and some Python. Our backend code is currently closed-source, but our Bicep repo gives an example of our coding style.2 projects | reddit.com/r/atljobs | 3 Feb 2022
The Microsoft Azure Deployments team aims to make deploying resources to Azure simple, safe, predictable, and reliable. We own the Template deployment orchestration service, client-facing tools including our open source DSL - Bicep, and various other services aimed at bringing customers up to speed with Infrastructure as Code. We are at the heart of the Azure control plane with great opportunities for cross-team collaboration and impact, have a lot of autonomy to shape the direction of our own products, and enjoy having a hands-on approach with customers to help drive our feature design.
Bicep Feedback - Add subscription as parameter for resource groups.
1 project | reddit.com/r/AZURE | 28 Jan 2022
u/nezoic can you open an issue for this here please: https://github.com/Azure/bicep/issues
ARM Templates Question
1 project | reddit.com/r/AZURE | 17 Jan 2022
Beginners Guide to Caching Inside an Apache Beam Dataflow Streaming Pipeline Using Python
1 project | dev.to | 9 Mar 2022
will do the job, but due to a bug in versions prior to this commit the tag parameter will be ignored. The cached object is going to be reloaded even if you provide the same identifier, rendering the whole mechanism useless and our transformation will hit our attached resources every time.
GCP to AWS
1 project | reddit.com/r/dataengineering | 29 Jan 2022
Apache Beam a framework in which we can implement batch and streaming data processing pipeline independent of the underlying engine e.g. spark, flink, dataflow etc.
A trick to have arbitrary infix operators in Python
5 projects | news.ycombinator.com | 25 Jan 2022
Apache Beam works this way. Code sample: https://github.com/apache/beam/blob/master/examples/multi-la...
Jinja2 not formatting my text correctly. Any advice?
11 projects | reddit.com/r/learnpython | 10 Dec 2021
ListItem(name='Apache Beam', website='https://beam.apache.org/', category='Batch Processing', short_description='Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream processing'),
The Data Engineer Roadmap 🗺
11 projects | dev.to | 19 Oct 2021
Frameworks of the Future?
9 projects | dev.to | 21 Jul 2021
I asked a similar question in a different community, and the closest they came up with was the niche Apache Beam and the obligatory vague hand-waving about no-code systems. So, maybe DEV seeming to skew younger and more deliberately technical might get a better view of things? Is anybody using a "Framework of the Future" that we should know about?
Best library for CSV to XML or JSON.
2 projects | reddit.com/r/javahelp | 1 Jul 2021
Apache Beam may be what you're looking for. It will work with both Python and Java. It's used by GCP in the Cloud Dataflow service as a sort of streaming ETL tool. It occupies a similar niche to Spark, but is a little easier to use IMO.
How to guarantee exactly once with Beam(on Flink) for side effects
1 project | dev.to | 16 May 2021
Now that we understand how exactly-once state consistency works, you might think what about side effects, such as sending out an email, or write to database. That is a valid concern, because Flink's recovery mechanism are not sufficient to provide end to end exactly once guarantees even though the application state is exactly once consistent, for example, if message x and y from above contains info and action to send out email, during failure recovery, these messages will be processed more than once which results in duplicated emails being sent. Therefore other techniques must used, such as idempotent writes, transaction writes etc. To avoid the duplicated email issue, we could save the key of the message that have been processed to a key-value data storage, and use that to check the key, however, since steam processing means unbounded message, it is tricky to manage this key-value checker with large throughput or unbounded time window by yourself. Here I will explain one approach to guarantee end to end exactly once such as only sending out email once with Apache Beam.
Apache Beam in Production
1 project | reddit.com/r/dataengineering | 22 Apr 2021
No, Beam comes with many runners and can run in many environments, including locally. The Python SDK is the easiest to get running and here is the quickstart guide. It runs this simple wordcount script.
Ecosystem: Haskell vs JVM (Eta, Frege)
4 projects | reddit.com/r/haskell | 30 Mar 2021
Dataflow is Google's implementation of a runner for Apache Beam jobs in Google cloud. Right now, python and java are pretty much the only two options supported for writing Beam jobs that run on Dataflow.
What are some alternatives?
Pester - Pester is the ubiquitous test and mock framework for PowerShell.
azure-cli - Azure Command-Line Interface
terraform - Terraform enables you to safely and predictably create, change, and improve infrastructure. It is an open source tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.
Apache Hadoop - Apache Hadoop
Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
azure-quickstart-templates - Azure Quickstart Templates
Scio - A Scala API for Apache Beam and Google Cloud Dataflow.
infracost - Cloud cost estimates for Terraform in pull requests💰📉 Love your cloud bill!
Apache Hive - Apache Hive
Airflow - Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Apache HBase - Apache HBase