Discover and read the best of Twitter Threads about #dataprocessing
Most recents (4)
1/11 🚨 Attention developers! The new EU Data Act may impact smart contract development, but @Conste11ation $DAG offers a solution for building dApps in compliance with new regulations. Here's why you should consider Constellation for your projects. 🌐 #EUDataAct #SmartContracts 
2/10 📜 The EU Data Act is not specifically aimed at the crypto industry, but it focuses on IoT data. However, it could have implications for smart contracts, which underpin DeFi infrastructure, if the scope isn't clearly defined. ⚠️ #IoT #DeFi
3/10 🔐 Article 30 of the Data Act focuses on "essential requirements regarding smart contracts for data sharing" and includes rigorous access control mechanisms, trade secret protections, and termination or interruption possibilities. 🛡️ #SmartContractRegulations
1/10 @Conste11ation $DAG & @quant_network $QNT groundbreaking partnership to revolutionize blockchain technology and cryptocurrency, focusing on secure, scalable, and connected ecosystems! A new era of interoperability is upon us! 🌐 #BlockchainIntegration
2/10 🤝 The $DAG & $QNT collaboration brings together Constellation's HyperGraph network and Quant's Overledger, enabling seamless integration, enhanced scalability, and top-notch security for businesses looking to embrace blockchain technology. 🛡️ #CryptoPartnership
3/10 🏙️ Connected cities are set to transform with this partnership! $DAG's HyperGraph network will enrich #IoT data by incorporating public data feeds, such as transit and financial data, to create smarter and more autonomous networks. 🌟 #SmartCities
How to consume any Database as a Stream for heavy data processing using JavaScript 🤯🔥
🧵/1
#javascript #nodejs #streams #sql #nosql #tutorial #dataprocessing #database #business #data #strategy #pipeline @nodejs
🧵/1
#javascript #nodejs #streams #sql #nosql #tutorial #dataprocessing #database #business #data #strategy #pipeline @nodejs
The secret for processing anything using JavaScript is to handle data on demand.
Imagine data you wanna migrate data from a SQL database to a NoSQL DB. You would need to apply some business rules, clean up fields, filter data and then output them to the final output.
/2
Imagine data you wanna migrate data from a SQL database to a NoSQL DB. You would need to apply some business rules, clean up fields, filter data and then output them to the final output.
/2
You might know that you can block the Node.js (and the data source you're consuming) if you handle too much data at once in memory
The best practice then is to limit results, send individual data to a stream pipeline, and then ask for more data until you've consumed it all.
/3
The best practice then is to limit results, send individual data to a stream pipeline, and then ask for more data until you've consumed it all.
/3
Why JavaScript Generators fix 90% of your problems when working with big loads of data 🤯
Let's? 🧵 /1
Let's? 🧵 /1
I've seen many people facing performance problems on the @nodejs platform or even on vanilla JS on the browser and when I ask what's happening they usually blame the language. /2
Although, when I look at the implementation, I see they are trying to process all the data simultaneously. /3
