Fast Multidimensional Matrix Multiplication on CPU from Scratch
18 by georgehill | 1 comments on Hacker News.
Wednesday, July 31, 2024
New top story on Hacker News: Ask HN: Best Tools for Monorepo?
Ask HN: Best Tools for Monorepo?
12 by bradhe | 15 comments on Hacker News.
I've got a monorepo I'm working in that has a Golang backend with a couple services and a Next.js front-end. Everything lives in a monorepo together. My tooling is super weak, though! For instance, for process management in development I'm using Goreman, which is a Foreman alternative in Goalng. Wondering what's the state of the art for managing the processes in local dev in monorepos in 2024? Or other tools for managing a monorepo I might be missing in general!
12 by bradhe | 15 comments on Hacker News.
I've got a monorepo I'm working in that has a Golang backend with a couple services and a Next.js front-end. Everything lives in a monorepo together. My tooling is super weak, though! For instance, for process management in development I'm using Goreman, which is a Foreman alternative in Goalng. Wondering what's the state of the art for managing the processes in local dev in monorepos in 2024? Or other tools for managing a monorepo I might be missing in general!
Tuesday, July 30, 2024
Monday, July 29, 2024
New top story on Hacker News: Can the moon influence human health? New research
Can the moon influence human health? New research
22 by sabrina_ramonov | 11 comments on Hacker News.
22 by sabrina_ramonov | 11 comments on Hacker News.
Sunday, July 28, 2024
New top story on Hacker News: Show HN: I built an open-source tool to make on-call suck less
Show HN: I built an open-source tool to make on-call suck less
16 by aray07 | 1 comments on Hacker News.
Hey HN, I am building an open source platform to make on-call better and less stressful for engineers. We are building a tool that can silence alerts and help with debugging and root cause analysis. We also want to automate tedious parts of being on-call (running runbooks manually, answering questions on Slack, dealing with Pagerduty). Here is a quick video of how it works: https://youtu.be/m_K9Dq1kZDw I hated being on-call for a couple of reasons: * Alert volume: The number of alerts kept increasing over time. It was hard to maintain existing alerts. This would lead to a lot of noisy and unactionable alerts. I have lost count of the number of times I got woken up by alert that auto-resolved 5 minutes later. * Debugging: Debugging an alert or a customer support ticket would need me to gain context on a service that I might not have worked on before. These companies used many observability tools that would make debugging challenging. There are always a time pressure to resolve issues quickly. There were some more tangential issues that used to take up a lot of on-call time * Support: Answering questions from other teams. A lot of times these questions were repetitive and have been answered before. * Dealing with PagerDuty: These tools are hard to use. e.g. It was hard to schedule an override in PD or do holiday schedules. I am building an on-call tool that is Slack-native since that has become the de-facto tool for on-call engineers. We heard from a lot of engineers that maintaining good alert hygiene is a challenge. To start off, Opslane integrates with Datadog and can classify alerts as actionable or noisy. We analyze your alert history across various signals: 1. Alert frequency 2. How quickly the alerts have resolved in the past 3. Alert priority 4. Alert response history Our classification is conservative and it can be tuned as teams get more confidence in the predictions. We want to make sure that you aren't accidentally missing a critical alert. Additionally, we generate a weekly report based on all your alerts to give you a picture of your overall alert hygiene. What’s next? 1. Building more integrations (Prometheus, Splunk, Sentry, PagerDuty) to continue making on-call quality of life better 2. Help make debugging and root cause analysis easier. 3. Runbook automation We’re still pretty early in development and we want to make on-call quality of life better. Any feedback would be much appreciated!
16 by aray07 | 1 comments on Hacker News.
Hey HN, I am building an open source platform to make on-call better and less stressful for engineers. We are building a tool that can silence alerts and help with debugging and root cause analysis. We also want to automate tedious parts of being on-call (running runbooks manually, answering questions on Slack, dealing with Pagerduty). Here is a quick video of how it works: https://youtu.be/m_K9Dq1kZDw I hated being on-call for a couple of reasons: * Alert volume: The number of alerts kept increasing over time. It was hard to maintain existing alerts. This would lead to a lot of noisy and unactionable alerts. I have lost count of the number of times I got woken up by alert that auto-resolved 5 minutes later. * Debugging: Debugging an alert or a customer support ticket would need me to gain context on a service that I might not have worked on before. These companies used many observability tools that would make debugging challenging. There are always a time pressure to resolve issues quickly. There were some more tangential issues that used to take up a lot of on-call time * Support: Answering questions from other teams. A lot of times these questions were repetitive and have been answered before. * Dealing with PagerDuty: These tools are hard to use. e.g. It was hard to schedule an override in PD or do holiday schedules. I am building an on-call tool that is Slack-native since that has become the de-facto tool for on-call engineers. We heard from a lot of engineers that maintaining good alert hygiene is a challenge. To start off, Opslane integrates with Datadog and can classify alerts as actionable or noisy. We analyze your alert history across various signals: 1. Alert frequency 2. How quickly the alerts have resolved in the past 3. Alert priority 4. Alert response history Our classification is conservative and it can be tuned as teams get more confidence in the predictions. We want to make sure that you aren't accidentally missing a critical alert. Additionally, we generate a weekly report based on all your alerts to give you a picture of your overall alert hygiene. What’s next? 1. Building more integrations (Prometheus, Splunk, Sentry, PagerDuty) to continue making on-call quality of life better 2. Help make debugging and root cause analysis easier. 3. Runbook automation We’re still pretty early in development and we want to make on-call quality of life better. Any feedback would be much appreciated!
Saturday, July 27, 2024
New top story on Hacker News: Show HN: Semantic Grep – A Word2Vec-powered search tool
Show HN: Semantic Grep – A Word2Vec-powered search tool
9 by arunsupe | 1 comments on Hacker News.
Much improved new version. Search for words similar to the query. For example, "death" will find "death", "dying", "dead", "killing"... Incredibly useful for exploring large text datasets where exact matches are too restrictive.
9 by arunsupe | 1 comments on Hacker News.
Much improved new version. Search for words similar to the query. For example, "death" will find "death", "dying", "dead", "killing"... Incredibly useful for exploring large text datasets where exact matches are too restrictive.
Friday, July 26, 2024
Thursday, July 25, 2024
Wednesday, July 24, 2024
Tuesday, July 23, 2024
New top story on Hacker News: Show HN: Zerox – document OCR with GPT-mini
Show HN: Zerox – document OCR with GPT-mini
12 by themanmaran | 3 comments on Hacker News.
This started out as a weekend hack with gpt-4-mini, using the very basic strategy of "just ask the ai to ocr the document". But this turned out to be better performing than our current implementation of Unstructured/Textract. At pretty much the same cost. I've tested almost every variant of document OCR over the past year, especially trying things like table / chart extraction. I've found the rules based extraction has always been lacking. Documents are meant to be a visual representation after all. With weird layouts, tables, charts, etc. Using a vision model just make sense! In general, I'd categorize this solution as slow, expensive, and non deterministic. But 6 months ago it was impossible. And 6 months from now it'll be fast, cheap, and probably more reliable!
12 by themanmaran | 3 comments on Hacker News.
This started out as a weekend hack with gpt-4-mini, using the very basic strategy of "just ask the ai to ocr the document". But this turned out to be better performing than our current implementation of Unstructured/Textract. At pretty much the same cost. I've tested almost every variant of document OCR over the past year, especially trying things like table / chart extraction. I've found the rules based extraction has always been lacking. Documents are meant to be a visual representation after all. With weird layouts, tables, charts, etc. Using a vision model just make sense! In general, I'd categorize this solution as slow, expensive, and non deterministic. But 6 months ago it was impossible. And 6 months from now it'll be fast, cheap, and probably more reliable!
Monday, July 22, 2024
Sunday, July 21, 2024
Saturday, July 20, 2024
Friday, July 19, 2024
Thursday, July 18, 2024
Wednesday, July 17, 2024
New top story on Hacker News: Show HN: VisCircuit – A Note-Taking Website for Electronics and Circuits
Show HN: VisCircuit – A Note-Taking Website for Electronics and Circuits
7 by darrenyaoyaoyao | 0 comments on Hacker News.
Hi, everyone. I created a note-taking website for electronics and circuits where you can draw circuit diagrams and write text notes at the same time. I am a Digital IC designer, and I self-study different types of analog and digital circuits a lot. However, I found a problem. Circuits have many different architectures and are hard to memorize due to numerous experiential tips. I want to document what I learn in my note app, but I found there is no method for me to easily draw circuit and block diagrams alongside text notes. This issue has bothered me for a long time, from my master's school to my current working life. I decided to solve it, so I created a note-taking website specifically for electronics and circuits, called VisCircuit. With VisCircuit, you can easily draw circuit diagrams, block diagrams, and write text notes simultaneously. I have already used it for two weeks and have noted down things I find hard to remember, such as SRAM, amplifier circuits, and PCB components of Arduino and Raspberry Pi. I found this tool really useful for memorizing knowledge about electronics and circuits. Currently, I have opened VisCircuit for alpha testing, and I want to let some people use it and give me feedback. Feel free to try it, and I will really appreciate what you think about this project. Leave any suggestions for improvement. Thank you very much.
7 by darrenyaoyaoyao | 0 comments on Hacker News.
Hi, everyone. I created a note-taking website for electronics and circuits where you can draw circuit diagrams and write text notes at the same time. I am a Digital IC designer, and I self-study different types of analog and digital circuits a lot. However, I found a problem. Circuits have many different architectures and are hard to memorize due to numerous experiential tips. I want to document what I learn in my note app, but I found there is no method for me to easily draw circuit and block diagrams alongside text notes. This issue has bothered me for a long time, from my master's school to my current working life. I decided to solve it, so I created a note-taking website specifically for electronics and circuits, called VisCircuit. With VisCircuit, you can easily draw circuit diagrams, block diagrams, and write text notes simultaneously. I have already used it for two weeks and have noted down things I find hard to remember, such as SRAM, amplifier circuits, and PCB components of Arduino and Raspberry Pi. I found this tool really useful for memorizing knowledge about electronics and circuits. Currently, I have opened VisCircuit for alpha testing, and I want to let some people use it and give me feedback. Feel free to try it, and I will really appreciate what you think about this project. Leave any suggestions for improvement. Thank you very much.
Tuesday, July 16, 2024
Monday, July 15, 2024
Sunday, July 14, 2024
Saturday, July 13, 2024
Friday, July 12, 2024
Thursday, July 11, 2024
Wednesday, July 10, 2024
Tuesday, July 9, 2024
Monday, July 8, 2024
New top story on Hacker News: Show HN: I coded my own JSON translation tool to easily localize my side project
Show HN: I coded my own JSON translation tool to easily localize my side project
11 by jboschpons | 7 comments on Hacker News.
Hi HN, I’m Joan, the developer of Quicklang. I made this app to easily translate and keep in sync all my localization JSON files for my side projects. While searching online for a similar tool, I only found enterprise solutions that do not allow direct editing of JSON files. I used to use ChatGPT to translate the JSON translation file changes before coding Quicklang. However, I realized that ChatGPT only allows you to input short content for translation into another language (even if you provide a .json file), and each time I had to request translations for one language at a time. So, I decided to build an app that only sends the changes I’ve made to the OpenAI API and easily translates them into all the target languages for my side projects. Technical details: I used Next.js to build the front end and backend, and I use a custom VPS (EC2 instance) on AWS to handle the translation process. This is because the translation can take several minutes, and Vercel Functions time out after 10 seconds by default (up to 60 seconds on the Hobby plan). Finally, I save the translation files in an S3 bucket. What’s next? I want to add cool features like change history, the capability to add context to the OpenAI API to make translations as accurate as possible, and maybe allow developers to interact with the API in order to use the tool. Let me know your thoughts and feedback. It’s been a blast working on this so far, and I think it’s just neat :)
11 by jboschpons | 7 comments on Hacker News.
Hi HN, I’m Joan, the developer of Quicklang. I made this app to easily translate and keep in sync all my localization JSON files for my side projects. While searching online for a similar tool, I only found enterprise solutions that do not allow direct editing of JSON files. I used to use ChatGPT to translate the JSON translation file changes before coding Quicklang. However, I realized that ChatGPT only allows you to input short content for translation into another language (even if you provide a .json file), and each time I had to request translations for one language at a time. So, I decided to build an app that only sends the changes I’ve made to the OpenAI API and easily translates them into all the target languages for my side projects. Technical details: I used Next.js to build the front end and backend, and I use a custom VPS (EC2 instance) on AWS to handle the translation process. This is because the translation can take several minutes, and Vercel Functions time out after 10 seconds by default (up to 60 seconds on the Hobby plan). Finally, I save the translation files in an S3 bucket. What’s next? I want to add cool features like change history, the capability to add context to the OpenAI API to make translations as accurate as possible, and maybe allow developers to interact with the API in order to use the tool. Let me know your thoughts and feedback. It’s been a blast working on this so far, and I think it’s just neat :)
Sunday, July 7, 2024
Saturday, July 6, 2024
Friday, July 5, 2024
Thursday, July 4, 2024
Wednesday, July 3, 2024
Tuesday, July 2, 2024
New top story on Hacker News: Show HN: I Made an Open Source Platform for Structuring Any Unstructured Data
Show HN: I Made an Open Source Platform for Structuring Any Unstructured Data
27 by adithya-s-k | 7 comments on Hacker News.
Hey HN, I'm Adithya, a 20-year-old dev from India. I have been working with GenAI for the past year, and I've found it really painful to deal with the many different forms of data out there and get the best representation of it for my AI applications. That's why I built OmniParse—an open-source platform designed to handle any unstructured data and transform it into optimized, structured representations. Key Features: - Completely local processing—no external APIs - Supports ~20 file types - Converts documents, multimedia, and web pages to high-quality structured markdown - Table extraction, image extraction/captioning, audio/video transcription, web page crawling - Fits in a T4 GPU - Easily deployable with Docker and Skypilot - Colab friendly with an interactive UI powered by Gradio Why OmniParse? I wanted a platform that could take any kind of data—documents, images, videos, audio files, web pages, and more—and make it clean and structured, ready for AI applications. Check it out on GitHub: https://ift.tt/uHDg9wL
27 by adithya-s-k | 7 comments on Hacker News.
Hey HN, I'm Adithya, a 20-year-old dev from India. I have been working with GenAI for the past year, and I've found it really painful to deal with the many different forms of data out there and get the best representation of it for my AI applications. That's why I built OmniParse—an open-source platform designed to handle any unstructured data and transform it into optimized, structured representations. Key Features: - Completely local processing—no external APIs - Supports ~20 file types - Converts documents, multimedia, and web pages to high-quality structured markdown - Table extraction, image extraction/captioning, audio/video transcription, web page crawling - Fits in a T4 GPU - Easily deployable with Docker and Skypilot - Colab friendly with an interactive UI powered by Gradio Why OmniParse? I wanted a platform that could take any kind of data—documents, images, videos, audio files, web pages, and more—and make it clean and structured, ready for AI applications. Check it out on GitHub: https://ift.tt/uHDg9wL
Monday, July 1, 2024
Subscribe to:
Posts (Atom)