429 questions
1
vote
0
answers
24
views
Does GridDB Cloud support triggers or callbacks for real-time data processing?
I'm building a data ingestion pipeline with GridDB Cloud where IoT devices send temperature data every few seconds.
Once data is inserted into the container, I want to immediately trigger a function ...
- 21
0
votes
1
answer
49
views
Unable to integrate JIRA automation with AWS SNS FIFO Topic
I’m currently unable to integrate JIRA Automation with my AWS SNS FIFO topic. Previously, the integration worked fine when using a standard SNS topic. However, after switching to a FIFO topic, the ...
- 27
0
votes
1
answer
106
views
How to avoid creating circular dependencies between Order, Bot, and Exchange?
I'm working on a cryptocurrency grid trading system where bots create Order entities. When an Order is created, it triggers a domain event to send the order to the corresponding Exchange. The issue is ...
- 6,617
1
vote
2
answers
46
views
Compliance Central Microservice
I have multiple microservices in my solution, let's call them salary processing, cards, kyc docs, and I need to enforce compliance so that if a kyc doc has expired, I block the card, and if salary ...
- 71
3
votes
0
answers
115
views
Why does not using the Event dispatching thread cause a deadlock?
I have read this thread and verified that it results in a deadlock (JavaSE-22). However, I simply cannot figure out why. Can anyone kindly explain what exactly happens? I know that we are NOT supposed ...
- 142
0
votes
0
answers
48
views
How to Use GridDB for Event-Based Triggering in Time-Series Data?
I am building an event-based monitoring system using GridDB. The goal is to trigger alerts when specific conditions are met in time-series data. For example:
If a value exceeds a threshold for more ...
1
vote
0
answers
39
views
Are timers in Node.js part of event-driven architecture? Do they emit events when they expire?
I was wondering if timers are actually part of event-driven architecture in Node.js.
However, I haven't found anything mentioning it in the official Node.js documentation.
Does it actually emit any ...
1
vote
0
answers
40
views
Spring boot app cannot connect with Kafka within the container
In short
To repeat the issue, you may clone the project from:
https://github.com/ethanalef/event-driven-model
Then build both listener and publisher projects with maven, build the image with ...
- 75
1
vote
2
answers
316
views
publishEndpoint.Publish() Not Sending Messages with Kafka in MassTransit
I'm facing an issue where producer.Produce() works and successfully sends messages to Kafka, but publishEndpoint.Publish() doesn’t seem to produce any messages. I'm using MassTransit with Kafka, and I ...
0
votes
0
answers
50
views
How to efficiently process messages from Rabbit MQ?
I have an architecture-related question about implementing a Python API/Microservices that need to process 30 million incoming requests.
I am planning to to use RabbitMQ or Amazon SQS.
Question: ...
- 1,027
0
votes
1
answer
84
views
How to manage nested schema's in event driven architecture and where to store them?
We are developing an IoT cloud solution with an event driven architecture.
The devices produce events and communicate with consumers through an event broker. All event messages are serialized in JSON. ...
- 109
0
votes
1
answer
60
views
Decoupled communication between Stateful and a plain object
Looking for an answer from a senior architect in Flutter who knows the in and out of the SDK and the platform.
Objective is to get notified once a Stateful object comes to life or gets instantiated. ...
- 2,180
1
vote
2
answers
194
views
How to Maintain Data Integrity with Concurrent and Out-of-Order Events?
I'm building a back office tool with a microservices architecture, and I'm facing challenges with handling concurrent and out-of-order events.
Context:
I have microservices that emit events which are ...
- 886
0
votes
2
answers
180
views
How To Work With Subscriber? Laravel Nwidart Modules
I'm new to using Laravel Modules, and have tried Event-Driven (via Event-Listener) but there is a little problem, where when using the subscriber method, the listener doesn't listen to events and the ...
- 39
2
votes
1
answer
380
views
Understanding the Relationship Between EventEmitter in Node.js and addEventListener in the Browser
I'm currently delving into Node.js and exploring its unique features compared to JavaScript in the browser environment. One concept that caught my attention is the EventEmitter, which handles events ...
- 23
1
vote
1
answer
105
views
What is recommended when publishing multiple variations of a message?
I'm looking for a recommended approach for the following scenario.
I have an API endpoint through which one can add/remove their friends.
PATCH /api/me/friends HTTP/1.1
Content-Type: application/json
...
- 77
0
votes
1
answer
49
views
consumer is not invoked when publishing from another one
I have an issue using kafka with spring boot, I have a spring boot microservice that is linked to kafka,this app works fine, I can produce and consume events with no problem excpet this cas :
I need ...
- 184
1
vote
1
answer
82
views
writing event_management in unity
I am new to unity programming. I am reading the mastering unity scripting by alan thorn... now I am studying event driven programming. I am really confused about this code:
public delegate void ...
3
votes
0
answers
114
views
Events seems to vanish upon projection linking
I am using the EventStore solution for the event-driven approach in my new project. I've noticed an issue where emitting an event and linking to a stream seems to make previous events disappear from ...
- 169
0
votes
1
answer
118
views
Data Liberation in pure DDD
I am reading the book "Building Event Driven Microservices" by Adam Bellemare and there is a part that I do not understand:
In the perfect world, all state would be created, managed, ...
0
votes
1
answer
506
views
Transactional Outbox Pattern with AWS RDS
I am building event driven microservice architecture with Java and Spring. I want to implement transactional outbox pattern and listen for changes on my AWS RDS Postgres tables (CRUD operations ) and ...
- 45
1
vote
1
answer
323
views
Event driven microservice: which and how much data crosses boundaries? | Shopping cart examples
I am learning about event drive microservices. I think I understood the basics but can't wrap my head around a few things. This question is theoretically. I am not looking for answers like "use a ...
- 101
0
votes
0
answers
139
views
How to break inifine loop in a event driven architecture?
To understand the issue I provide a simplified diagram of my system:
Let's see the Business service allows you to create an account. It generates 1. Business event.
The event is processed by the ...
0
votes
2
answers
183
views
What is the Logic Behind Synchronization in CQRS with Separate Storages?
When using CQRS, we operate with two separate storages. How exactly is the sync operation performed in this context?
Let's say I used an event store database for the Write storage and Elasticsearch ...
- 31
0
votes
1
answer
75
views
Commands that need information from external systems
Let's say I'm implementing an application that manages stocks and portfolios using event sourcing. I have the following commands:
CreatePortfolio
BuyStocks
SellStocks
ClosePortfolio
The handling of ...
- 8,403
4
votes
2
answers
7k
views
Why do we need Outbox pattern with Kafka
I do not understand why we need the Outbox pattern when we have Event Driven architecture with Kafka.
Kafka offers Message Delivery Guarantees as described here, having idempoency on producers and ...
- 835
0
votes
0
answers
262
views
what is the real benefit of using outbox pattern in an event-driven architecture
According to all of the articles I've seen so far about the benefits of using the Outbox pattern in an event-driven architecture, they all use this pattern so if the Message Broker fails, messages don'...
- 2,286
5
votes
1
answer
705
views
WASAPI Capture shared event driven mode in WINDOWS SERVER 2016 and below
I am building an application to capture audio from the device using WASAPI Where all the API used support Windows vista and above devices.
Initially, I captured audio from the device with WASAPI ...
- 175
0
votes
1
answer
605
views
Kafka in microservices for providing transactions
Can Kafka be used to provide transactions between microservices?
Let's say we build a simple online store with 2 microservices: order and storage.
While placing an order, you want to also update the ...
- 15
0
votes
2
answers
65
views
Readable procedure not getting called when pipe has info
On linux I created a pipe file using 'mkfifo pip'. On one terminal, I issue 'tail -f pip' and in other I issue 'ls > pip'. I could see the information flow from second terminal to the first one.
...
- 71
2
votes
0
answers
900
views
How to trigger a lambda or glue job when a file is placed in SharePoint?
If a file is placed in Microsoft SharePoint I want to trigger my AWS lambda code to bring that file to S3 (An event driven approach). Is there any way to do this? Also, I don't want to schedule it.
As ...
- 21
0
votes
2
answers
1k
views
how to make rest requests with kafka and an api gateway
I'm new to event driven architecture and have a very basic question about Microservices communication.
Given I have a website that has to make REST requests to an API Gateway. Say it does a fetch() to ...
user21978638
0
votes
0
answers
431
views
How to do test automation for event driven architecture
We have a service A, which has AWS MSK event listener. It then processes the event and adds data into db.
We have get API on the service, which provides the data referring to the db in step above.
We ...
- 59
0
votes
2
answers
196
views
Can we completely avoid synchronous approach between microservices?
1)If 2 microservices (say order and payment services) can connect asynchronously, then we can avoid using circuit/retry/throttle patterns, right?
I really dont understand why going synchrnous ...
- 25
0
votes
1
answer
2k
views
Azure Functions - BlobTrigger - How to trigger function with any file in a container?
I'm facing a problem with an Azure Function.
I've build an Azure Function triggered by a new file on a container of a storage account.
The problem is that it seems impossible (to me) to trigger the ...
- 650
0
votes
1
answer
177
views
Why KeyEvent getCharacter returns a string not a character
Based on my understanding, the getCharacter() method of KeyEvent should return a char type.
For example, if I have to check if the typed key is a digit, I can just use Character.isDigit(e.getCharacter(...
- 363
0
votes
1
answer
665
views
ABP.IO - Handle multiple events in same microservice
Considering the below documentation and the example to handle different events
https://docs.abp.io/en/abp/latest/Distributed-Event-Bus#pre-defined-events
Do I need to have 3 microservices to handle ...
- 5,917
1
vote
1
answer
515
views
Is it OK to not read eventfd to clear the value?
I use eventfd just to wake up epoll_wait(). I do not care about the value in eventfd. So can I not call read() on eventfd to avoid one syscall?
My program is restarted every month, so the 64-bit value ...
- 525
1
vote
2
answers
615
views
Microservices streaming data vs events
In microservices architecture, you can follow an event driven architecture where you want to publish events, doubt it’s about size of the payload.
What is a reasonable amount of data to be there?
You ...
- 2,189
0
votes
1
answer
66
views
Can RabbitMQ transfer a message only after a monitored condition becomes true
Can RabbiMQ or any other queuing service do the following usecase?
A customer (Server #1) uploads a data folder to a storage server (Server #2).
The customer then wants to request an analysis server (...
- 3,627
1
vote
1
answer
1k
views
How to check data integrity/consistency in asynchronous (event-driven) system
Let's say we have an asynchronous event-driven system where service A owns some data, publishes events and service B is consuming them and is storing the copy of the data in its local DB.
I'd like to ...
- 14.4k
0
votes
1
answer
551
views
Retry logic for integrating with an external API
Imagine we have an asynchronous, event-driven microservice architecture in place. As part of some business function, one of our services needs to reach out to a third party API. This API happens to be ...
- 100
1
vote
0
answers
95
views
Filtering messages on one of thousands of values in AWS - event-driven architecture
We are working on a system in which one microservice publishes an event on a bus and many others microservices are subscribed to that bus.
Some of the subscribed microservices want to filter the ...
- 656
1
vote
0
answers
1k
views
Creating an event driven architecture using Django
I would like to create an event driven architecture in Django. Every time a database record is created, updated or deleted, i would like to create and event, posting it to a queue ( like kafka, sqs, ...
- 8,446
7
votes
3
answers
1k
views
Can a domain event be emitted without being part of an aggregate state change (DDD)
I would like to know how can a domain event be implemented (in DDD) if it is not a natural result of an aggregate's state change.
I will borrow the example of this post.
So lets say that we need an ...
- 773
5
votes
1
answer
2k
views
Domain Events vs Event notification vs Event-carried state transfer ECST in event driven architecture, implementing Domain Driven Design (DDD)
I would like to clarify in my mind the way different kinds of events could be implemented in a EDA system (system with Event Driven Architecture) implementing DDD (Domain Driven Design). Let assume ...
- 773
1
vote
1
answer
335
views
How to "replay" past integration events to replicate current state in a new context
I'm quite new to DDD and Event Driven architectures. And after searching this issue I did not manage to get a clear answer by myself, so I'll appreciate if someone can clarify this.
Suppose I ...
- 73
1
vote
1
answer
560
views
Applying SAGA pattern in situations where immediate feedback to user is required
Imagine there is an app where a user has a wallet which they can top it up with cash, cash it out or make purchases from an external system, when the user creates a new purchase order, we first deduct ...
- 255
3
votes
1
answer
370
views
Guarantying eventual consistency without a message broker (utilising an in memory message bus)
I am thinking if there could be an easy way to guarantee eventual consistency in an event driven modular monolith, which is utilising an in process message bus instead of an actual external message ...
- 773
1
vote
1
answer
120
views
Migrating an asynchronous businness flow to an event-driven system
In the effort to redesign an asynchronous flow based functional service to an event driven one, we have come up with changes on different part of this system. The service receives various statuses ...
- 2,932