iCreatAI News
Back to main site
Skip to content
#Deployment
Nov 5Thu
  1. Baseten Blog22

    Baseten joins the NVIDIA Nemotron Coalition to advance custom AI in production

    Baseten has joined the NVIDIA Nemotron Coalition, expanding its collaboration with NVIDIA on open frontier models, post-training, RL environments, and dedicated inference. The post cites CodeRabbit's Nemotron 3.5 Lightning customization, which raised routing-policy agreement from 75.8% to 80.7% on 1,000 tasks and cut inference cost 50.4% at saturated throughput, and notes Harvey post-trains Nemotron on Baseten for legal workflows. Baseten Loops now supports Nemotron 3.5 Super VL and Nemotron 3 Ultra, with customers retaining ownership of trained weights.

  2. Hacker News AI58

    Dropbox's next chapter: moving your work forward with AI in Dropbox

    Dropbox is rolling out a new AI experience that lets customers find, understand, create, edit, and organize content directly within Dropbox, with model choice, approval plans, undo, and action records; it has reached more than 70,000 teams, initially for eligible Standard and Advanced teams in the US, UK, and Australia in English, with broader availability planned for 2027. Dropbox also announced DBX Agent Cloud, starting with S3-compatible standalone object storage, and the planned acquisition of Tigris Data Inc., with filesystem and content-processing capabilities to follow. Customers can additionally work on Dropbox files in supported AI tools including ChatGPT, Claude, and Muse without re-uploading content.

  3. Cerebras Blog50

    What It Took to Build Wafer-Scale, and Why It Lasts

    Cerebras CEO Andrew Feldman rebuts a Culper Research short-seller report claiming its wafers wear out after about two years, saying the company does not use the PariPoser material and that its patented assembly keeps temperatures steady and even while flexible connections absorb thermal expansion. He cites TSMC qualification for 10 years of continuous operation at 105°C and an average junction temperature below 65°C across deployed CS-3 systems, arguing Arrhenius modeling with those inputs implies 33 years at maximum temperature and over a century at average. Feldman also says fewer than 0.5% of deployed CS-3 wafers have been decommissioned since 2024 and defends the company's 3-5 year depreciation schedule as conservative.

  4. NVIDIA Newsroom20

    ‘Hogwarts Legacy’ Gets a Magical NVIDIA DLSS 5 Upgrade on GeForce NOW

    Hogwarts Legacy now supports NVIDIA DLSS 5 with 3D-Guided Neural Rendering on GeForce NOW, adding lifelike lighting and material detail while retaining the game's underlying geometry, textures and artistic intent. World of Warcraft: Forever launched Nov. 4 on the service with CurseForge add-on support and a launch-week access reward through Nov. 11, and Ubisoft added expansions for Tom Clancy's The Division 2 and Anno 117: Pax Romana. Two-dozen games join the GeForce NOW library in November, including eight this week.

  5. Hacker News AI34

    Building a Self-Updating AI Pipeline for Expense Extraction

    Billino describes a self-updating expense-extraction pipeline in which user corrections are captured as labeled cases, distilled by an LLM into candidate one-line rules, validated through shadow runs and replay against existing tests, then activated per tenant and vendor so later extractions re-run with the new rules. The post walks through the full loop from upload to promotion and discusses pitfalls including personal data in invoices, narrow rules, limited bug coverage, scope, and setup, API, and stability costs.

  6. Hacker News AI36

    Why Vaadin Browserless Testing Is a Game Changer for AI Generated Web Apps

    The post argues that Vaadin Browserless Testing runs full integration tests, including UI code, in milliseconds without a browser or web server, since Vaadin Flow views are server-side Java calling services in the same JVM. It contrasts this with SPA architectures, where frontend, backend and end-to-end tests form three toolchains and the frontend-backend contract is only covered by slow, fragile e2e tests. The author says this speed and determinism suit AI coding agents and yield a single JaCoCo coverage number for UI, services and jOOQ repositories.

  7. Databricks Blog36

    Push-based CDC into Unity Catalog with Zerobus Ingest and Debezium

    Debezium Server 3.7 ships an open-source Zerobus Ingest sink, built by Databricks with NVIDIA's contribution of envelope mode, that pushes change events directly into Unity Catalog Delta tables without a Kafka cluster between capture and the lakehouse. Envelope mode lands each full Debezium change event in a fixed nine-column table with source position and an idempotency key, and the sink waits for Zerobus to confirm durability before Debezium advances its offset, giving at-least-once delivery. Landed events can then be shaped into Type-1 current-state tables via AUTO CDC sequenced by source LSN, or Type-2 history tables.

  8. Hacker News AI58

    Show HN: Ergon - build AI agents in code or on a canvas that generates Python

    Ergon is a monorepo toolkit for building AI agent harnesses, combining a Python SDK engine with a drag-and-drop visual Studio that generates Python code against it. The SDK covers tool-calling loops, control flow, a unified router for roughly 15 providers, RAG, MCP clients, browser control, OpenTelemetry traces and an evaluation harness, while the Studio adds a canvas, inspector, live preview and codegen. A bootstrap script sets up both halves, and harnesses can be served as REST + SSE endpoints or deployed via Docker with Postgres/pgvector and Redis.

  9. Hacker News AI48

    Novel AI framework runs on optical hardware

    Researchers including a University of Tokyo team combined an SS-DFA training method with a simpler "single-map framework" architecture and demonstrated it in an optical computing system using a 200-meter optical fiber and few electronic components. The simplified design matched or in some tests outperformed more complex neural networks while requiring far less computation, measurement and data storage. The team says future work must test scaling to the largest AI models and address miniaturization, stability and large-scale manufacturing.

  10. Hacker News AI34

    Faaah (Filesystem as an AI Handler) – Agent Subscription as OpenAI API via Files

    FAAAH is a dependency-free, 308-line Python proxy that turns an OpenAI-compatible endpoint into a plain-text file protocol: it writes incoming requests to prompt-<id>.txt files in a queue directory, and an existing AI coding agent (e.g. Claude Code, opencode) reads them and writes responses to response-<id>.txt files, which FAAAH packages back into OpenAI-compatible JSON. It supports the OpenAI tools parameter with multi-turn tool loops, optional local embeddings via a uv extra, and a human-in-the-loop fallback where you can type the answer yourself; streaming is not supported. The author frames it as reusing an AI agent subscription for weekend side projects and notes caution about massive datasets and provider ToS.

  11. Browser Use Blog38

    Computer Use vs Browser Use: How AI Agents Should Control Software

    This article compares computer-use agents, which operate a whole desktop from screenshots by moving the mouse and keyboard, with browser-use agents, which drive a real browser over the Chrome DevTools Protocol by reading page structure and acting on elements. It recommends browser use for web tasks because it is more precise, scriptable and parallelizable, and computer use for steps that leave the browser, such as desktop apps or OS dialogs. It also notes that many workflows need both approaches combined.

  12. MarkTechPost62

    Together AI Releases Together Compiler: Agents Make Inference Up to 2.6x Faster

    Together AI introduced Together Compiler (TKCC), an agent-driven continual compilation loop that uses coding agents to rewrite a model's forward pass and re-optimize inference as production traffic changes, already running on several of its serverless endpoints. Tested on models including Kimi K3, GLM 5.3, MiniMax M3.1 Flash, DeepSeek v4.1 Flash and Llama 1B across NVIDIA B200, B300, GB300, H100, AMD MI355X and AWS Trainium2, it reported up to 2.6x higher TPS than the best published InferenceX configurations in under 24 hours per setting, with gains ranging from about 4% (GLM 5.3 on MI355X, 463 to 480 TPS) to 1,111 P90 TPS per user on MiniMax M3.1 Flash (B200, batch size 1) versus a 633 TPS baseline. The system starts the engine once and swaps forward function pointers over RPC, using a fast 12-layer tier and a slow 60-layer tier that tested 8.1x more candidates (1,354 vs 168) and found a solution 7.2% faster, with results self-reported.

  13. Hacker News AI38

    Secure meeting room for humans that AI can't see

    Qube is a protected cloud meeting room that runs sessions, shared files, and apps inside a disposable virtual machine, using DRM/CDM playback and session controls to keep content invisible to local capture software and AI assistants. It requires no installation, integrates with existing scheduling and workplace tools, and destroys the virtual machine and its temporary workspace when a meeting ends. Qube also offers diarized transcripts tied to in-room actions and a comparison table claiming capabilities such as forensic watermarking and deepfake defense.

  14. ElevenLabs Blog22

    Fix speech to text accuracy problems with a smarter workflow

    This guide explains that speech to text accuracy depends on audio input quality, speaker dynamics, and lexical and contextual issues, and that fixes should target the input, processing, or output stage of the pipeline. It recommends recording at 16 kHz or higher in lossless formats with microphones four to six inches from the speaker, using voice isolation, diarization or multichannel recording, and keyterm prompting, and measuring accuracy with word error rate. It also notes that ElevenAPI offers Scribe v2 with keyterm prompting, multichannel transcription, and speaker diarization.

  15. Hacker News AI36

    Rack Community: a self-hosted AI lab whose job runner won't overload the box

    Rack Community is a self-hosted, single-box AI lab with live host gauges, a durable job runner that admits jobs only when their declared memory peaks fit under a limit, recipe-based job templates, a human-approved memory control plane (Somnus), and a team room (TalkBack) that AI agents can join. It ships no model or keys, works with Ollama or any OpenAI-compatible endpoint, starts in dry-run, and binds to 127.0.0.1 with token-checked writes. Version 1.0.0 is the first public release under MIT.

  16. Fireworks AI Blog72

    Kimi K3.1 Pro is live on Fireworks

    Moonshot AI's Kimi K3.1 Pro is available on Fireworks at launch, either serverless with pay-per-token pricing or on a dedicated deployment for reserved capacity. Moonshot post-trained K3.1 Pro from K3 and replaced K3's full-attention layers with sparse attention to make long contexts more efficient to serve. Fireworks reports it sits on the quality-for-cost frontier on five Specialized Intelligence Index benchmarks, ranking first of 19 on Sierra's τ³-Banking at 64.7%, and lists serverless pricing at $2.00 per million uncached input tokens, $0.20 cached input and $10.00 output.

    Why it matters: Useful for readers weighing a newly launched open model against named competitors on cost and benchmark placement.

  17. vLLM Blog72

    Introducing Kinference: An Open Source Inference Control Plane for vLLM and Kubernetes

    Buoyant announced Kinference, an Apache v2 open source control plane for building inference platforms on vLLM and Kubernetes, offering token rate limiting, tenant usage and cost tracking, KV-cache-aware load balancing, and a YAML-based inference policy engine. The post reports benchmarks in which Kinference cut median time-to-first-token by 95% and median end-to-end latency by 45% versus standard Kubernetes load balancing on one workload, and served 7.4× the goodput on a shared-prefix workload and about 3.5× on multiturn. It also covers per-tenant inference metrics and Helm-based installation steps.

    Why it matters: It gives a concrete look at cache-aware routing and policy-driven model selection for self-hosted vLLM deployments, backed by published benchmarks.

  18. Hacker News AI40

    CodeRabbit – Automated review, triage, and security for AI-generated PRs

    CodeRabbit presents a platform for managing AI-generated pull requests, offering AI code reviews with customizable profiles, PR triage that scores and routes changes, a Change Stack for explaining large diffs, and continuous security monitoring that verifies and fixes findings in a PR. It also offers a Slack agent for planning, incident response, and triage.

  19. Databricks Blog60

    Introducing Apache Spark® 4.3 - Now available in Databricks Runtime 19

    Apache Spark 4.3 extends Real-Time Mode to stateful processing, adding streaming aggregation, dropDuplicates, and Scala/Java transformWithState, with three benchmarked stateful workloads reporting P99 end-to-end latency below 150 ms. The release also adds SCD Type 2 support to Auto CDC, Project Feather's opt-in shuffle-free single-task execution and Arrow-native caching, Spark Connect observability and JDBC improvements, and SQL features including JSON_TABLE, VARIANT transformations, ASOF JOIN, and a nanosecond timestamp preview. It also begins a quarterly feature-release cadence, moving from one release every six months to one every three months.

    Why it matters: Useful for readers tracking Spark's shift toward low-latency stateful streaming and its new quarterly release cadence.

  20. Hacker News AI40

    Show HN: I built a hosting for small AI-generated software

    host0 is a hosting service that turns files or folders created by AI coding agents (Claude Code, Codex, Cursor and others) into shareable links, with apps private by default until shared. It offers sharing controls, a database declared in h0.json, analytics, and one-click rollback of deploys on the Pro plan. A free plan is available, with Pro at $9/mo for removing the badge, larger files and 30 days of version history.

  22. Hacker News AI65

    OpenRing – self-hosted voice AI agents with a Vapi-compatible API

    OpenRing is an MIT-licensed, self-hosted voice AI agent platform that runs on your own machine or server with your own provider keys and no platform fee, speaking the same JSON as Vapi so clients can migrate by changing the base URL. It runs each call as a Pipecat pipeline (speech-to-text, model, voice) and supports Vapi-style assistants, tools, webhooks, phone numbers, campaigns, knowledge bases, squads and SIP trunks, with a free local stack of Whisper, Ollama and Kokoro. It starts with `npx openring` on Node.js 18 or later, and calls, transcripts and keys stay on your server with no telemetry.

  23. Baseten Blog58

    Introducing Baseten Router: a Pareto-optimal model router for coding tasks

    Baseten Router routes each coding task between models such as Opus 5.5 and GLM 5.3 Flash based on predicted success rate and cost, and in benchmarks spanning DeepSWE 1.1, SWE Atlas QnA and Terminal-Bench 2.1 it came within 0.8 percentage points of Opus 5.5's pass rate at 72% lower cost. Baseten says it was the only commercial router it evaluated that beat random routing at the same cost by a statistically significant margin, with configurable Cost, Balanced and Intelligence thresholds. It is part of Baseten Grid, now in public preview.

  24. Hacker News AI72

    Advancing the Quality-Efficiency Frontier for Coding AI on Windows PCs

    Microsoft describes MAI-Code-1.1-Flash, a 137.9-billion-parameter mixture-of-experts coding model quantized from roughly 276 GB at 16-bit precision to a 53.0 GiB mixed-precision checkpoint (with a 46.1 GiB variant), running locally on NVIDIA RTX Spark PCs via GitHub Copilot. Using a DFlash2 speculative-decoding draft with layer-wise sliding-window attention, the measured RTX Spark configuration reached a median 51.12 tokens per second at 120K-token input context, with median end-to-end latency falling 27% from 527.25 to 382.41 seconds.

  25. The Verge · AI31

    Gemini for Home now plugs into AT&#038;T’s smart security system

    AT&T's Connected Life system now integrates with Google Home Premium, which AT&T says makes it the first home security product to do so, enabling Gemini-powered features that describe camera events, let users search recorded video with natural-language questions, and provide daily activity summaries. These features require AT&T's $29.99/month professional Connected Life monitoring plan, and AT&T is also adding automatic arming or disarming based on proximity to the home. AT&T launched Connected Life last December with Google and Abode and is now using Google's Gemini-powered Home APIs.

  26. Databricks Blog42

    The Enterprise Case for Open-Weight Models on Databricks

    Databricks field engineers describe seven pressures pushing enterprises away from single frontier-model providers, including insufficient returns on AI spend, frequent ranking changes, guardrail refusals, shifting data-retention policies, governance demands, harness effects on performance, and open-weight models now benchmarking comparably to frontier models at lower cost. They present Unity Gateway as a unified API for routing and governing open-weight, frontier, and external models, citing internal data showing average unique models per customer rose from 4.2 to 7.1 since January, with roughly 40% open-weight. The post also notes GLM 5.2 reaching about 40% of open-weight tokens on Unity Gateway a month after launch and Databricks' $3 billion July raise, partly for GPU capacity to host open models.

  27. Simon Willison38

    datasette-agent 0.5a0

    Datasette Agent 0.5a0 is a significant release whose most notable new feature is called the panel, which lets the agent chat open and sit next to pages from Datasette, such as a table or query page. Combined with datasette-apps, this means you can prompt a database-backed app into existence and then modify it from the chat next to that app. It can be tried by signing in with a GitHub account at agent.datasette.io.

  28. AWS Machine Learning Blog38

    Use decision models with Amazon Bedrock AgentCore Evaluations

    This post explains how to connect decision models—Jev from TypeSafe and the open-source Strands Decider 2B—to Amazon Bedrock AgentCore Evaluations through code-based evaluators running in AWS Lambda, converting evaluator input into decision model requests and probabilities back into evaluation results. It describes noul, choice, and score question types, positions decision models as a calibrated screening layer alongside rather than a replacement for built-in LLM-as-a-judge evaluators, and outlines a five-step process for validating a decision-model evaluator against labeled traffic. A full code sample in the AgentCore samples GitHub repository deploys an HR Assistant agent evaluated by deterministic checks, built-in evaluators, and decision-model evaluators.

  30. Claude Blog38

    New agents and products for security, productivity, and creative work on Claude Marketplace

    Anthropic added new partner agents and products to Claude Marketplace across security, developer infrastructure, creative, and productivity, bringing the total to over 25. Eligible enterprise customers can apply a portion of their committed Anthropic spend toward these solutions. New listings include Chainguard, Checkmarx, Cyera, Rubrik, Tanium, Datadog, Netlify, AirOps, Runway, Webflow, Asana, Glean, monday, and Zoom.

  32. ElevenLabs Blog22

    AI voice agent pricing: What it costs for your business

    AI voice agent pricing combines three line items: the platform that runs the agent, the LLM that powers each conversation, and the telephony provider that connects calls. Using ElevenAgents pricing as an example, every paid tier works out to $0.08 per platform minute, with LLM and telephony billed separately at cost, and plans ranging from a free tier with 15 minutes per month to custom Enterprise pricing. The guide also covers concurrency limits, ROI calculation against staffing costs, hidden costs, and ways to reduce spend.

  33. Hacker News AI69

    Show HN: Atlas – Let AI agents use your Mac without taking over your screen

    Atlas is a free, open-source MIT-licensed tool that gives AI agents a hidden second macOS login on your Mac, where they can open apps, click and type while you keep working in your own account. It supports Claude, Codex, Cursor, opencode and Pi, queues agents one at a time, and reports lower context use than native Computer Use (e.g. 36k vs 232k tokens for Claude Opus 5.5 across three tasks). It is not a security sandbox, and some features like native Save/Open panels and Safari web views require a connected Screen Sharing session.

  34. Baseten Blog62

    Introducing Baseten Grid

    Baseten Grid is a single layer for enterprises to route requests across approved open and closed models, monitor usage, and govern access, with a gateway supporting providers including OpenAI, Anthropic, Gemini Enterprise Agent Platform, Amazon Bedrock, and Baseten. In early benchmarks, its Baseten Router cut cost per coding task by up to 70% with minimal quality loss, and Grid also adds centrally configurable guardrails. Grid is in public preview starting today.

    Why it matters: Useful for teams weighing AI coding costs, as it details a routing-and-governance layer with specific benchmark claims and supported providers.

  35. Hacker News AI38

    AI Is Getting Better. Running It Yourself Is Getting Harder

    The article argues that large Mixture-of-Experts models such as DeepSeek-V3 (671B total, 37B active parameters) and Llama 4 Maverick (400B total, 17B active) can be efficient to compute yet costly to host, since all weights must remain available even when only a subset is activated per token. It contends that batching and shared deployments favor large providers, so open weights may become centralized in practice as self-hosting costs rise, and it suggests shared colocated clusters and research into compression, distillation, and expert offloading as responses.

  36. Hacker News AI58

    Launch HN: Kino AI (YC S23) – AI media manager and video editor

    Kino AI launched on Hacker News as a combined media manager and video editor that stores footage and assets, offers a rich editor, and provides review links for teammates, letting colleagues and coding agents like Codex and Claude Code work on the same timeline. The editor is code-first, built on Remotion, with all editing, motion graphics, timeline dragging, comments, and 3D scenes expressed as code, and it is fully collaborative and real-time with visible teammate cursors. Footage is transcribed, embedded, described, and face-detected, with a low-res proxy uploaded so teammates and cloud inference can access it while local scrubbing uses custom pro media decoders.

  38. AWS Machine Learning Blog38

    How Indegene is modernizing and scaling enterprise data quality in life sciences

    Indegene built an LLM-powered Data Quality Agent within its NEXT Unified Data Platform on AWS, using Amazon Bedrock, Strands Agents, and Amazon Bedrock AgentCore to generate context-aware data quality rules, validate them, and produce SQL and Python code under human-in-the-loop governance. The agent draws on internal enterprise and external reference knowledge bases via RAG to recommend technical and life sciences-specific business rules. Indegene reports the agent reduced rule definition and implementation effort from about 30 hours to about 4 hours per dataset and cut new table onboarding from 2–5 working days to 2–4 hours.

  39. AWS Machine Learning Blog58

    Four layers of context engineering for production AI agents: How Deep Insight applies them in working code

    This post presents a four-layer context engineering approach for production AI agents—architectural isolation via multi-agent design, prompt-based output control, filesystem-based context externalization, and independent verification with safeguards—illustrated through Deep Insight, an open source multi-agent data analysis solution built on the Strands Agents SDK and Amazon Bedrock AgentCore. Reported results include roughly 95 percent fewer tokens added to context per script from a combined write-and-execute tool and roughly 97 percent smaller system prompts from on-demand skill loading. It is Part 2 of a three-part series.

  40. AWS Machine Learning Blog55

    Smart Approvals in AWS Quick: Human oversight where it matters

    AWS describes Smart Approvals in AWS Quick, which uses a separate classifier model to review eligible agent actions against the user's request and either approve them automatically or return them for human review, without granting additional permissions or removing required approvals. Policy controls such as Custom Permissions, Quick Guardrails, connector action permissions and user settings determine eligibility, and each automatic approval is single-use and applies only to the exact action and parameters reviewed. The post also covers CloudTrail and CloudWatch Logs audit evidence and recommends piloting Smart Approvals with a defined workflow before wider rollout.