(오늘의 짤방: Reality > Data > Model via @paulabartabajo)
- 빅데이터/인공지능
- 구글의 두 번째 의료 특화 LLM, Med-PaLM 2
- Dive Into LoRA Adapters
- Beating GPT-4 on HumanEval with a Fine-Tuned CodeLlama-34B
- Dense Text-to-Image Generation with Attention Modulation
- "LLM은 문서 초반의 정보는 잘 가져오지만 중간에 있는 건 제대로 못 가져온다" - 인간미가 느껴졌다
- Perplexity is your AI research assistant. It has a conversational interface, contextual awareness and personalization to learn your interests and preferences over time.
- Demo of reproduced VALL-E X
- Very impressive. WizardCoder 34B outperforms GPT-4, Claude, and Bard on HumanEval.
- Lots of confusion around bf16 vs fp16 for llama-2
- Ahead of AI #11: New Foundation Models
- We now have the most comprehensive cookbook on building LLMs with Knowledge Graphs
- RAG graph example(colab)
- A strong foundation in Mathematics can help you excel in the field of Data Science! Today, I'll share some top FREE resources on Maths for ML.
- Fast Vector Similarity Library
- [Week of 8/21] LangChain Release Notes
- Embedchain is a framework to easily create LLM powered bots over any dataset.
- How do we 𝗗𝗲𝗰𝗼𝗺𝗽𝗼𝘀𝗲 𝗥𝗲𝗮𝗹 𝗧𝗶𝗺𝗲 𝗠𝗮𝗰𝗵𝗶𝗻𝗲 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴 𝗦𝗲𝗿𝘃𝗶𝗰𝗲 𝗟𝗮𝘁𝗲𝗻𝗰𝘆 and why should you care to understand the pieces as a ML Engineer?
- Automated Metadata Extraction for Better Retrieval + Synthesis
- 🌲Multi Vector Retriever
- AI2 Dolma: 언어모델을 위한 3T 토큰 오픈 코퍼스 (blog.allenai.org)
- MS에 빼고 총집합?··· 구글, 아마존, 엔비디아 등 허깅페이스에 2억 달러 투자
- Visualizations of Embeddings
- "챗GPT 언급한 채용 공고, 21배 증가" 채용 시장의 AI 기술과 기업 동향
- Llama 2 learns to code
- "AI 기술 없으면 일자리가 위험하다" IBM-옥스포드 이코노믹스 보고서
- “윈도우 그림판에 새로운 AI 기능 추가될 수 있다”
- K-Means Clustering - An Explorable Explainer
- Fine-Tuning Embeddings for RAG with Synthetic Data
- Introducing Code Llama, a state-of-the-art large language model for coding
- "잠재력은 인정, 열광은 조심”··· 과장 징후의 기술 4가지
- Check out these new guides for 13 popular LLM use-cases.
- 데이터 양이 ADAS 훈련에 정말 최선일까? - 열등한 데이터 세트, 사고 위험 증가시킬 수 있다
- One major way to improve your RAG system is to fine-tune your embedding model ⚙️
- 메타, 멀티모달 AI 모델 '심리스M4T' 발표 "최대 100개 언어 지원"
- "쇼핑객 17%가 구매 위해 생성형 AI 사용" 세일즈포스 보고서
- Understanding Transformers: A Step-by-Step Math Example — Part 1
- Code Llama - 코딩을 위한 최첨단 거대 언어 모델 (ai.meta.com)
- 오픈소스의 교훈을 생성형 AI에 적용하자
- IBM, '코드 어시스턴트' 코볼에서 자바로 자동 변환
- 김준구 네이버웹툰 CEO “저작권 논란 없는 AI툴 개발 중”
- Google "We Have No Moat, And Neither Does OpenAI"
- OpenCopilot solves this problem so building your own Copilot becomes intuitive, fast and reliable - all so you can build your copilot in a single day.
- Whisper API - Speech to Text Transcription
- fai - Everything you need to launch your AI product
- Using LangSmith to Support Fine-tuning
- Run more pods per GPU with NVIDIA Multi-Instance GPU
- GPT-3.5 파인 튜닝 후기
- The Impact of chatGPT (2023) by MIT Department of Physics
- Salesforce, 5.3조원 가치로 AI스타트업 HuggingFace에 투자를 진행중 (theinformation.com)
- Semantic search with embeddings: index anything
- Mind Maps plugin for ChatGPT
- Will be interesting how this LoRA-on-demand service will compare to open-source LoRA on prem.
- Generative AI for Blender - AI generate video, image, and audio from text prompts or video, image, or text strips.
- A Math Lover’s Guide to Hidden Markov Models
- functime is a powerful Python library for production-ready global forecasting and time-series feature engineering.
- Fine Tuning GPT-3.5-Turbo
- OPENAI IS FUNDING AN APP FOR PARENTS TO MANAGE KIDS' LIVES
- IBM says GenAI can convert that old COBOL code to Java for you
- A few quick thoughts on why exploring multilingual language models would be beneficial…
- Awesome 한국어 음성인식 (github.com/rtzr)
- 11M document subset of OBELICS: an open collection of interleaved image-text web documents, containing 141M English documents, 115B text tokens, and 353M images.
- LoRA-style LLM finetuning is now available for all models in Lit-GPT
- Less than 23 hours since the new Midjourney feature "In-Painting" dropped..
- SeamlessM4T is designed to provide high-quality translation, allowing people from different linguistic communities to communicate effortlessly through speech and text.
- Cloud GPU 가이드 - AI에 어떤 GPU를 어디서 써야할까? (gpus.llm-utils.org)
- [Tip] 스노우가 2달 동안 150억 번 AI 프로필 이미지 만드는 방법 📷 (코드 있음)
- Topic Modeling with Llama 2 - Create easily interpretable topics with Large Language Models
- SeamlessM4T is designed to provide high quality translation, allowing people from different linguistic communities to communicate effortlessly through speech and text.
- Here are a few ways you can use @OpenAI’s new finetuning endpoints to optimize your LLM apps over your data 💡:
- IDEFICS is an 80 billion parameters multimodal model that accepts sequences of images and texts as input and generates coherent text as output.
- Benchmarking Question/Answering Over CSV Data
- Why You (Probably) Don’t Need to Fine-tune an LLM
- GPT-3.5 Turbo 미세 조정 및 API 업데이트 (openai.com)
- Outlines 〰 helps developers guide text generation to build robust interfaces with external systems.
- There’s two ways of performing more structured tagging/retrieval for production-quality RAG systems:
- Llama from scratch (or how to implement a paper without crying)
- 챗GPT 연계 이후 돈 잘 버는 AI 서비스 3곳
- Image embeddings
- AI-generated art cannot receive copyrights, US court says
- LLM 연구의 공개 과제들 (huyenchip.com)
- LlamaIndex + Metaphor: Towards Automating Knowledge Work with LLMs
- Python Polars: A Lightning-Fast DataFrame Library
- What motivated self-attention mechanisms in transformer-based LLMs in the first place?
- OpenAgent is a library of modular components and an orchestration framework.
- Master Finetuning LLMs on a single GPU!
- LlamaGPT - A self-hosted, offline, ChatGPT-like chatbot, powered by Llama 2. 100% private, with no data leaving your device. Code Llama support coming soon.
- NVIDIA AI Workbench Speeds Adoption of Custom Generative AI for World’s Enterprises
- Excited to share that my newest article "Building Custom Q&A Applications Using LangChain and Pinecone Vector Database" on Analytics Vidhya is out now📝🚀
- Deep Dive into pandas Copy-on-Write Mode - Part I
- Five facts: How customer analytics boosts corporate performance
- Welcome to the NaLLM project repository, where we are exploring and demonstrating the synergies between Neo4j and Large Language Models (LLMs).
- My Everyday LLM Uses
- Fooocus - SD 와 Midjourney에서 배운, 더 쉽고 편한 이미지 생성 소프트웨어 (github.com/lllyasviel)
- pykoi - LLM을 위한 데이터 & 피드백 수집용 UI 라이브러리 (cambioml.com)
- Become a Google Certified Data Scientist 🚀
- A core retrieval idea that will lead to better results for your LLM QA system is decoupling embedding representations from raw text chunks (s/o @md_rumpf for inspiration). ✂️
- Best Practices for Data Cleaning and Preprocessing
- Beginner’s guide to Llama models
- 퀴즈쇼 우승 ‘왓슨’, 암치료 나섰지만…결과는 ‘굴욕적 퇴출’
- GN⁺: Cruise, 충돌 사고 후 즉시 로보택시 편성을 50% 줄이라는 규제당국의 지시를 받음 (techcrunch.com)
- CoDeF: Content Deformation Fields for Temporally Consistent Video Processing
- Here are 8 key considerations for building *production-grade* LLM apps over your data (RAG) 💡 (see 🧵):
- Parent Document Retriever, as well as the cool diagram by @clusteredbytes! ❤️
- CS224u: Natural Language Understanding (Code for the Stanford course. Spring 2023
- Which GPU(s) to Get for Deep Learning: My Experience and Advice for Using GPUs in Deep Learning
- NumPy Examples — Practice Questions Make You an Expert
- Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Models
- Incognito Pilot combines a Large Language Model (LLM) with a Python interpreter, so it can run code and execute tasks for you. It is similar to ChatGPT Code Interpreter, but the interpreter runs locally and it can use open-source models like Llama 2.
- Patterns for Building LLM-based Systems & Products
- 생성 AI 경제 모델, 기존 AI와 어떻게 다른가?
- Awesome-Korean-LLM : 한국어 오픈소스 LLM awesome list (github.com/NomaDamas)
- What's the connection between World War II 🪖 and Classification Models 👨💻?
- Simpson’s Paradox and Interpreting Data
- 엔씨, 자체 개발 언어모델 VARCO LLM 공개
- These women fell in love with an AI-voiced chatbot. Then it died
- CTransformers - Python bindings for the Transformer models implemented in C/C++ using GGML library.
- The Poisson Hidden Markov Model for Time Series Regression
- Why You (Probably) Don’t Need to Fine-tune an LLM
- Should we be more persuasive?
- Sweep - AI 쥬니어 개발자 (github.com/sweepai)
- DeepEval - LLM을 위한 유닛 테스팅 (github.com/mr-gpt)
- Visual Blocks is a framework that allows any platform or application to easily integrate a visual and user-friendly interface for ML creation.
- 어떤 LLM이 더 낫지?··· 아서, AI 모델 비교·분석 도구 ‘아서 벤치’ 오픈소스로 출시
- 나날이 풍성해지는 선택지··· 기업용 생성형 AI 모델과 유형 진단
- “AI 아닌 기술에도 관심 가져야”··· 가트너, 신흥 기술 하이프 사이클 2023’ 발표
- 'AI로 구글 검색에 도전했지만'...마이크로소프트 빙 점유율 예전 그대로
- How to Develop LSTM Models for Time Series Forecasting
- Catching up on the weird world of LLMs
- Amazon Kendra로 모든 유형에 대한 자료 검색 구축하기 [2부 – 음성 및 영상 검색]
- DevOpsGPT: AI-Driven Software Development Automation Solution
- DoctorGPT - 미국 의사 면허 시험을 통과하는 LLM (github.com/llSourcell)
- 'New York Times' considers legal action against OpenAI as copyright tensions swirl
- “AI 콘텐츠, 팩트체크 더 세심하게 하라”··· AP, 언론인을 위한 생성형 AI 가이드라인 공개
- Here is a little prompt we developed that will generate quiz questions for whatever PDF reading you have opened in Edge with the Bing sidebar.
- “5가지 주요 직업군이 보는 생성형 AI는?”··· 세일즈포스, 연구 결과 발표
- ‘일관된 판단이 장점’ 오픈AI, 콘텐츠 조정 업무에의 GPT-4 활용 방안 제시
- 토종 AI의 반격…코난, 자체모델로 "기업시장 공략"
- ‘K-초거대AI’ 윤곽… 네이버는 유료, 카카오는 무료
- Department of Health and Human Services: Artificial Intelligence Use Cases Inventory
- Reflections on “Making the Atomic Bomb”
- Meta의 OpenAI에 대한 다음 공격: 무료 코드 생성 소프트웨어 (theinformation.com)
- 크롬 브라우저가 AI를 이용해 전체 기사를 요약 예정 (blog.google)
- TextFX is an AI experiment that uses Google's PaLM 2 large language model. These 10 tools are designed to expand the writing process by generating creative possibilities with text and language.
- Roboflow Inference is an opinionated tool for running inference on state-of-the-art computer vision models.
- Another blockbuster AI startup in town! Congrats David @hardmaru & Llion @YesThisIsLion on launching http://sakana.ai!
- What Smart Companies Know About Integrating AI
- It is fascinating how quickly our mediocre-but-good-enough-until-ChatGPT tools for identifying humans from machines have failed.
- Meet Decicoder, an LLM proficient at writing code
- Introducing: LoRA the Explorer 🤠🚀 Explore, try out, and download curated SDXL LoRAs to generate images with your favorite styles! Crayon, pixel art, 3D render, cyborg, watercolor, and much more!
- Teach LLMs to Personalize
- Finetuning LLaMa + Text-to-SQL
- 토종 생성형 AI 출격 앞둔 네이버, 상반기 R&D에 1조 썼다
- 생성 AI의 엔비디아 GPU 탈출은 가능할까 | 학습 인프라는 상황 종료...추론에 틈새 보여
- Stanford XCS224U: Natural Language Understanding I Spring 2023 (Stanford Online)
- GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
- Stable Diffusion XL playground by NVidia
- NVidia NGC AI models(pretrained)
- 구글 헬스, 엑스레이 분석 솔루션 업체 아이캐드에 AI 지원
- Subs AI - OpenAI Whisper로 동영상의 자막 자동 생성하기 (github.com/abdeladim-s)
- 가트너 ”생성형 AI 기대감 최고조” | 2023년 이머징 테크놀로지 하이프 사이클 발표
- Datasette Cloud, Datasette 1.0a3, llm-mlc and more
- AI Has Already Created As Many Images As Photographers Have Taken in 150 Years. Statistics for 2023
- GN⁺: Opendream: Stable Diffusion을 위한 레이어 기반 UI (github.com/varunshenoy)
- 챗GPT 넘어라··· 다양한 LLM 활용이 필요한 때
- 생성 AI 만난 포토샵, 빠진 이미지 다 그려 넣어주네 | 어도비, '생성형 확장' 기능 공개…편집 절차 간소화
- 생성AI 모델 레이스 새국면...구글, '제미니'로 하반기 대공세
- FoodSAM: Any Food Segmentation
- 삼성표 '생성형 AI' 나온다…10월 테스트 시작
- Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment
- OpenAI Adapter (langchain)
- 🦜🔗 Text-to-graph playground - This playground explores the use of OpenAI functions and LangChain to build knowledge graphs from user-input text.
- Do we really need a specialized vector database?
- Creating a chatbot that can accurately answer questions about a product or service's documentation is a complex task. You can fine-tune on the documentation itself (but results won't be conversational), use embeddings (risks losing relevant context), etc. gpt-oracle-trainer is an experimental tool that aims to simplify this process and potentially produce better results.
- Introducing DeciCoder: A new open-source LLM, specialized for generating code in Python, Java, and Javascript.
- Did you know you could finetune Llama2 on Kaggle notebooks with multi-gpu for FREE?! Check out this notebook:
- Deploy LLM on Kubernetes using OpenLLM
- New breakthrough from Meta AI: Instruction Backtranslation. Applied to LLama this method outperformed Claude, Guanaco, LIMA, and Falcon-Instruct.
- We present “Graph RAG” in @llama_index : a new method of augmenting LLMs with context from a graph database 🔎✨
- GN⁺: 아마존, 제품 리뷰를 요약하는 생성형 AI 기능 출시 (apnews.com)
- stable-diffusion.cpp - Inference of Stable Diffusion in pure C/C++
- Anti-hype LLM reading list
- 📐 The 🤗 Open Object Detection Leaderboard aims to track, rank and evaluate vision models available in the hub designed to detect objects in images.
- How is LLaMa.cpp possible?
- Understanding the patterns of the universe - the omnipresent normal distribution
- I was surprised by a talk Yejin Choi (an NLP expert) gave yesterday in Berkeley, on some surprising weaknesses of GPT4: As many humans know, 237*757=179,409 but GPT4 said 179,289.
- 새로운 루다를 지탱하는 모델 서빙 아키텍처 — 3편: 안정적인 LLM 서비스를 위한 서빙 최적화 기법
- ChatGPT answers more than half of software engineering questions incorrectly - You may want to stick to Stack Overflow for your software engineering assistance.
- PyTorch Model Performance Analysis and Optimization — Part 3
- In bioinformatics, a sequence logo is a graphical representation of the sequence conservation of nucleotides (in a strand of DNA/RNA) or amino acids (in protein sequences).
- How to Build a Real-Time Feature Pipeline In Python
- The ChatGPT hype cycle:
- Stable Diffusion Crash Course for Beginners
- STUDY: Socially aware temporally causal decoder recommender systems
- FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization
- Benchmarking Question/Answering Over CSV Data
- Multi-modality is another 10x UX improvement in the same way that chat was.
- LLMOps: Deploy Open LLMs using Infrastructure as Code with AWS CDK
- I created a simple example data science project. It includes a makefile that you can copy and use to easily make your own.
- Fooocus is an image generating software. Fooocus is a rethinking of Stable Diffusion and Midjourney’s designs:
- 인프콘 2023 핸즈온, ChatGPT API: 다양한 인공지능 서비스 개발하기 자료입니다.
- Embedding speed may matter as much as performance if you're building RAG with local models! ⚡️ We ran a simple benchmark on @huggingface embedding models 🤗 - throughput as a function of model / batch size / string length.
- 바른팀에서 구축한 한국어 모호성 평가 데이터세트를 소개합니다.
- 최고 성능의 한국어 형태소 분석기 「바른」을 무료로 사용해 보세요.
- ✅Image Classification in ML/Deep Learning- Explained in simple terms with implementation details
- ⚡ Lit-GPT - Hackable implementation of state-of-the-art open-source large language models released under the Apache 2.0 license.
- DoctorGPT is a Large Language Model that can pass the US Medical Licensing Exam.
- Wrapper's Delight: An Enhanced OpenAI Wrapper
- Zep - LLM/Chatbot을 위한 장기 메모리 저장소 (github.com/getzep)
- 🤗 PEFT - State-of-the-art Parameter-Efficient Fine-Tuning (PEFT) methods
- 네이버 “AI 집중”…판교 빌딩 팔아 현금 3000억대 확보
- Tree-based ML algorithms - why they are the most popular models in the real world
- Neuralangelo - This is the official implementation of Neuralangelo: High-Fidelity Neural Surface Reconstruction.
- 🥇Top ML Papers of the Week
- 이상 탐지 3부-머신 러닝으로 이상 탐지하기
- Google DeepMind’s CEO Says Its Next Algorithm Will Eclipse ChatGPT
- Dify - 사용하기 쉬운 LLMOps 플랫폼 오픈소스 (github.com/langgenius)
- 인공지능(AI) 활용서: 6대 산업별 활용사례 by 딜로이트
- "AI가 클라우드 스타트업 지형도 바꾼다" 2023년 포브스 클라우드 100
- SKT 글로벌 AI사업 강화 앤스로픽에 1억달러 투자
- Awesome Key Infomation Extraction
- Retake - Postgres용 하이브리드 검색 오픈소스 (github.com/getretake)
- liteLLM - 50개 이상의 LLM을 지원하는 프록시 서버 (github.com/BerriAI)
- 프폼프트 인스트럭션 개선을 위한 힌트
- More people should be training their own embeddings Why? Because it costs <$1000 to train a SOTA embeddings model
- FaceChain is a deep-learning toolchain for generating your Digital-Twin. With a minimum of 1 portrait-photo, you can create a Digital-Twin of your own and start generating personal portraits in different settings (multiple styles now supported!).
- Meta AI, Vision 모델을 위한 PUG(Photorealistic Unreal Graphics) 데이터셋 공개 (pug.metademolab.com)
- LLM As DBA
- 올여름의 불타는 LLM: 세상도 불타고 나도 불타고
- GPT detectors are biased against non-native English writers
- AI가 이제 인간보다 CAPTCHA 테스트에서 더 뛰어나
- PUG: Photorealistic and Semantically Controllable Synthetic Data for Representation Learning
- AI 관련 종사자 관심 우선순위 ‘생성AI·컴퓨터 비전·데이터 분석·자연어 처리’
- Code Understanding (langchain)
- "Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models
- llm-attacks - Universal and Transferable Adversarial Attacks on Aligned Language Models
- Real-Real-World Programming with ChatGPT - Taking AI Far Beyond Small Self-Contained Coding Tasks
- Introducing English as the New Programming Language for Apache Spark
- California man's business is frustrating telemarketing scammers with chatbots
- The Lone Banana Problem. Or, the new programming: “speaking” AI
- Adversarial Policies Beat Superhuman Go AIs
- AutoChain takes inspiration from LangChain and AutoGPT and aims to solve both problems by providing a lightweight and extensible framework for developers to build their own agents using LLMs with custom tools and automatically evaluating different user scenarios with simulated conversations.
- Awesome LLMOps - An awesome & curated list of the best LLMOps tools for developers.
- An introduction to graph theory
- Welcome to Apache OpenNLP - The Apache OpenNLP library is a machine learning based toolkit for the processing of natural language text.
- Zep and LlamaIndex: A Vector Store Walkthrough
- Llama 2 Powered By ONNX
- Top Generative AI tools for Data Scientists and Coders
- Multilevel Regression Models and Simpson’s paradox - Avoiding false conclusions with the proper tooling
- AI21 Labs Accelerates Generative AI Model Adoption Using Amazon SageMaker
- Anserini: OpenAI-ada2 Embeddings for MS MARCO Passage Ranking
- The NeurIPS 2023 LLM Efficiency Challenge Starter Guide
- QAmeleon introduces synthetic multilingual QA data contaning in 8 langauges using PaLM-540B, a large language model.
- Metadata Replacement + Node Sentence Window
- 🦜⚒️Evaluating Q&A Systems with Dynamic Data 🔄
- 어떻게 효율성을 유지할까?...오픈AI GPT-4의 비밀
- 엔비디아 '쿠다'에 도전한다...모듈러, 6억달러 가치에 투자 유치 협상 중
- api2ai - OpenAPI 스펙을 읽어서 코드를 작성해주는 API 비서 (github.com/mquan)
- 하드웨어
- 읽을거리
(보너스: Data center revenue: Nvidia $NVDA vs $AMD vs Intel $INTC via @StockMKTNewz)
EOB
댓글 없음:
댓글 쓰기