Buyer guide · Updated October 2026

Deploying AI in Infrastructure You Control

Most AI products ask you to send your data to them. A custom build can run the other way round: the agent, the documents and the logs stay in your cloud account or tenant, and your security team reviews it like any other internal system. Here is what that actually involves.

Get a scoped estimate

Direct answer

Can a custom AI agent run in our own cloud?

Yes. A custom AI agent or Private GPT can be deployed into your AWS, Azure or Google Cloud account, your Microsoft 365 or Google Workspace tenant, or on-premises hardware. Your identity provider controls who can use it, your storage holds the documents and logs, and the only data that leaves is the request sent to the model provider you approve, or none at all if you run an open-weight model inside the boundary.

What you give up is convenience: your team provisions the account, grants access and owns the cloud bill. What you get is that the system is yours, passes your security review on your terms, and keeps running if the vendor relationship ends. HummingAgent builds this way by default; the K3 Technology Private GPT deployment described in our case studies is one example.

What stays where: the data flow

Every deployment conversation should start with a one-page diagram of where data goes. For a Private GPT the usual answer is: documents in your storage, embeddings and search index in a database in your account, the application and its logs in your compute, user identity from your directory, and a request to the model endpoint for each question. The model endpoint is the one place data crosses a boundary, which is why its choice gets the most attention.

For an agent that takes actions, add the integrations to the diagram. Each one is a credential your system holds, scoped to the least access the workflow needs. Credentials live in your secrets manager, never in a prompt or a config file.

ComponentWhere it livesWho controls access
Source documents and recordsYour storage (S3, Blob, SharePoint, Drive) or your databasesYour IT, through existing permissions
Search index and embeddingsA database in your accountYour IT; the application reads it
Application and review screensYour compute (containers, serverless, or a VM)Your identity provider (Entra ID, Okta, Google) via SSO
Logs and audit trailYour logging service, with your retention policyYour security team
Model callsProvider endpoint you approve (Azure OpenAI, Bedrock, Vertex AI, Anthropic), or an open-weight model in your accountContract terms and network rules you set
Integration credentialsYour secrets managerYour IT; rotated on your schedule

Choosing the model boundary

There are three realistic positions, and the right one depends on your data classification, not on preference.

  • Provider API with enterprise terms (Azure OpenAI, AWS Bedrock, Google Vertex AI, Anthropic): data is not used for training, is processed in a region you choose, and is covered by the provider's enterprise agreement. Right for most business data. Lowest effort.
  • Provider endpoint inside your cloud perimeter (private endpoints, VPC peering): same models, but traffic never crosses the public internet. Right for regulated data where the network path matters to auditors.
  • Open-weight model on your own GPUs (Llama, Mistral and similar families): nothing leaves. Right for the strictest classifications, at the cost of running and updating model infrastructure yourself. Quality and cost are improving every quarter, but this remains the most work to operate.
HummingAgent is model-agnostic. We will build to whichever boundary your security team approves and swap models later without rebuilding the application, because the model is one component behind an interface, not the product.

What your security review will ask

Treat the agent like any new internal application and the review goes smoothly. These are the items that come up in nearly every review we have been through, and what we bring to each.

Review itemWhat we provide
Data flow and classificationThe one-page diagram, with each data class labeled and the model boundary marked
Identity and accessSSO through your directory; role-based access mapped to your existing groups; no local accounts
Secrets handlingAll credentials in your secrets manager; no keys in code, prompts or configuration files
Logging and auditEvery request, retrieved source and action logged to your logging service with your retention policy
Prompt injection and misuseRetrieval limited to sources the user already has permission to read; tools gated by allow-lists; high-impact actions require a person
Vendor termsThe model provider's data-processing terms, region and training-exclusion commitments, in writing
Incident responseWho is paged, how the system is disabled, and how a bad action is reversed, agreed before launch
ExitYou hold the code, the infrastructure and the data. Ending support with HummingAgent does not turn anything off

Who does what

Your side provisions and owns; our side builds and documents. Being explicit about this at the start is what keeps a deployment on schedule.

TaskYour teamHummingAgent
Cloud account or subscriptionCreates it, sets billing and guardrailsSpecifies what is needed and why
Network and identityConfigures SSO, groups, private endpointsProvides the integration requirements and tests them
Infrastructure as codeReviews and approvesWrites it, hands it over with the repository
Application buildSupplies real examples and a reviewerBuilds, evaluates against the examples, documents
Security reviewRuns it against your standardSupplies the evidence listed above and fixes findings
Launch and monitoringOwns the on-call path if you want itSets up dashboards and alerts; optional ongoing support

What it costs

Deploying in your own infrastructure changes the shape of the cost more than the size. The build fee is similar to a hosted build; the difference is some extra engineering for your environment and security review, which is why we ask you to decide on the deployment target at discovery rather than later. HummingAgent's planning ranges are $15,000 to $50,000 for a custom agent or integrated workflow and from $50,000 for multi-system builds; discovery starts at $2,500.

The operating cost moves onto your cloud bill: compute for the application, a database for the index, storage, logging, and model usage billed by your provider. For a Private GPT used by a small team this is typically a modest line item dominated by model calls; for a high-volume agent it is dominated by whatever the metered unit is, which is why we size it from your real volume. Ongoing HummingAgent support, if you want it, starts at $1,500 a month and is the only vendor fee.

When not to deploy in your own cloud

  • You have no one to own the account. If nobody on your side can approve access or read the bill, a managed deployment in HummingAgent infrastructure with your data boundaries documented is the honest choice until you do.
  • The data is not sensitive and the workflow is small. A focused build hosted for you costs less to run and launches faster. You can move it later; the application does not change.
  • You want the strictest boundary but will not fund the operations. Running open-weight models on your own GPUs is real work. If that work is not budgeted, a provider endpoint inside your perimeter is the stronger position.

Frequently asked questions

What is a Private GPT?

A company AI workspace that answers from your approved documents and systems, runs under your access controls, and sends requests only to a model provider you approve, or to a model running inside your own infrastructure. It is private in the sense that your data, prompts and logs stay with you, not that the model was trained only on your data.

Does our data get used to train the model?

Not under enterprise terms from the major providers (Azure OpenAI, AWS Bedrock, Google Vertex AI, Anthropic), which exclude customer data from training. We put the provider's written terms in the security review package. If you run an open-weight model yourself, the question does not arise.

Can it run fully offline or on-premises?

Yes, with an open-weight model on your own hardware. You take on the model infrastructure and updates. Most clients choose a provider endpoint inside their cloud perimeter instead, which keeps traffic private without operating GPUs.

Who owns the code?

You do. Client-specific code, infrastructure definitions and documentation are delivered to your repository. The statement of work also names any reusable HummingAgent components, third-party services and open-source dependencies so ownership is not ambiguous.

What happens if we stop working with HummingAgent?

The system keeps running. It is in your account, under your identity provider, with your credentials. You take over monitoring and vendor bills, or hand them to another team.

How long does a deployment in our own cloud take?

It depends on how quickly your team can provision the account, grant access and schedule the security review. The build itself is scoped at discovery with milestones; the environment setup on your side is usually the critical path, so we start it first.

Start with the data-flow diagram

A discovery session produces the one-page data flow for your workflow, the model boundary your security team can approve, and a scoped estimate with your cloud costs itemized.

Schedule a discovery call