GitHub user mwaag added a comment to the discussion: VR only starts to work at
100% after migration
Hi,
i stumbled upon this since i have a very similar issue but with some
differences.
First some differences in setup:
- Version 4.20.3.0
- Hypervisor: VMWare vCentred ESX Cluster 8.x (but only 1 Workload-Host, as
this is a testing-environment, management-server is on a dedicated ESX-Cluster
but managed from the same vCentre)
- connection from mgmt to CKS is stable (we run into this problem before
ourself, ssh -i ~cloud/.ssh/id_rsa -p 2222 cloud@<Public ip address of CKS
cluster> does work)
Here my issue:
- when using the default DefaultNetworkOfferingforKubernetesService Network
Offering (or just dont specify the target-network at deployment) my cluster
never reaches Running-State and seems to be stuck in Starting state. Wether the
kubeconfig is coming available via webinterface nor does this cluster ever run
into error state. The problem i see here is, there is no successful creation of
port-forwarding of 6443 to the control node, when i try to add it manually, i
get the error: Request failed. (431)
There are multiple services used ip 192.168.8.20. (case 1).
- But using an isolated network (that has the needed services enabled) within a
vpc do not raise this issue. The cluster is getting deployed fine and reports
running state successfully, kubeconfig gets downloadable via webinterface as
well when all nodes are deployed (case 2).
Naturally there are some differences between these offerings, here are my
listings of both offerings, can you spot the cause?
**list networkofferings id=e19d2436-5935-4943-a1d3-1540ac4fb41c
(DefaultNetworkOfferingforKubernetesService)**
{
"count": 1,
"networkoffering": [
{
"availability": "Required",
"conservemode": true,
"created": "2024-06-25T16:42:04+0200",
"displaytext": "Network Offering used for CloudStack Kubernetes service",
"egressdefaultpolicy": true,
"fornsx": false,
"fortungsten": false,
"forvpc": false,
"guestiptype": "Isolated",
"hasannotations": false,
"id": "e19d2436-5935-4943-a1d3-1540ac4fb41c",
"internetprotocol": "IPv4",
"isdefault": true,
"ispersistent": false,
"name": "DefaultNetworkOfferingforKubernetesService",
"networkrate": 200,
"service": [
{
"name": "Vpn",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"name": "PortForwarding",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"capability": [
{
"canchooseservicecapability": false,
"name": "SupportedSourceNatTypes",
"value": "peraccount"
},
{
"canchooseservicecapability": false,
"name": "RedundantRouter",
"value": "false"
}
],
"name": "SourceNat",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"name": "Dns",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"capability": [
{
"canchooseservicecapability": false,
"name": "ElasticIp",
"value": "false"
},
{
"canchooseservicecapability": false,
"name": "AssociatePublicIP",
"value": "true"
}
],
"name": "StaticNat",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"name": "UserData",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"name": "Dhcp",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"capability": [
{
"canchooseservicecapability": false,
"name": "SupportedLBIsolation",
"value": "dedicated"
},
{
"canchooseservicecapability": false,
"name": "ElasticLb",
"value": "false"
},
{
"canchooseservicecapability": false,
"name": "InlineMode",
"value": "false"
},
{
"canchooseservicecapability": false,
"name": "VmAutoScaling",
"value": "true"
}
],
"name": "Lb",
"provider": [
{
"name": "VirtualRouter"
}
]
},
{
"name": "Firewall",
"provider": [
{
"name": "VirtualRouter"
}
]
}
],
"serviceofferingid": "95c4a416-9c7e-467e-9e4a-e237ac4318b9",
"specifyasnumber": false,
"specifyipranges": false,
"specifyvlan": false,
"state": "Enabled",
"supportsinternallb": false,
"supportspublicaccess": false,
"supportsstrechedl2subnet": false,
"traffictype": "Guest"
}
]
}
**list networkofferings id=33c2d2a0-f230-4db8-9b29-bef8f0fa34de (the custom
one)**
{
"count": 1,
"networkoffering": [
{
"availability": "Optional",
"conservemode": false,
"created": "2024-06-26T12:08:30+0200",
"details": {
"internetProtocol": "IPv4"
},
"displaytext": "NAT for VPC with Loadbalancing",
"egressdefaultpolicy": true,
"fornsx": false,
"fortungsten": false,
"forvpc": true,
"guestiptype": "Isolated",
"hasannotations": false,
"id": "33c2d2a0-f230-4db8-9b29-bef8f0fa34de",
"internetprotocol": "IPv4",
"isdefault": false,
"ispersistent": false,
"maxconnections": 4096,
"name": "NAT for VPC with Loadbalancing",
"networkrate": 500,
"service": [
{
"name": "Vpn",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"name": "PortForwarding",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"capability": [
{
"canchooseservicecapability": false,
"name": "SupportedSourceNatTypes",
"value": "peraccount"
},
{
"canchooseservicecapability": false,
"name": "RedundantRouter",
"value": "false"
}
],
"name": "SourceNat",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"name": "Dns",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"capability": [
{
"canchooseservicecapability": false,
"name": "ElasticIp",
"value": "false"
},
{
"canchooseservicecapability": false,
"name": "AssociatePublicIP",
"value": "false"
}
],
"name": "StaticNat",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"name": "UserData",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"name": "Dhcp",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"capability": [
{
"canchooseservicecapability": false,
"name": "SupportedLBIsolation",
"value": "dedicated"
},
{
"canchooseservicecapability": false,
"name": "ElasticLb",
"value": "false"
},
{
"canchooseservicecapability": false,
"name": "InlineMode",
"value": "false"
},
{
"canchooseservicecapability": false,
"name": "VmAutoScaling",
"value": "true"
}
],
"name": "Lb",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
},
{
"name": "NetworkACL",
"provider": [
{
"name": "VpcVirtualRouter"
}
]
}
],
"serviceofferingid": "95c4a416-9c7e-467e-9e4a-e237ac4318b9",
"specifyasnumber": false,
"specifyipranges": false,
"specifyvlan": false,
"state": "Enabled",
"supportsinternallb": false,
"supportspublicaccess": false,
"supportsstrechedl2subnet": false,
"traffictype": "Guest"
}
]
}
GitHub link:
https://github.com/apache/cloudstack/discussions/12209#discussioncomment-17324861
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
